2020-07-06T13:09:04.270 INFO:root:teuthology version: 1.0.0-82c08ed 2020-07-06T13:09:04.272 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sidharthanup@teuthology --lock --name sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi --verbose --description fs/upgrade/volumes/import-legacy/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-verify.yaml} ubuntu_18.04.yaml} --block --archive /home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029 -- /tmp/teuthology-worker.y4h26k3_.tmp 2020-07-06T13:09:04.327 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-06T13:09:04.411 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029 branch: wip-fix-setxattr-client10 description: fs/upgrade/volumes/import-legacy/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-verify.yaml} ubuntu_18.04.yaml} email: null first_in_suite: false job_id: '5203029' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/mimic latest ' name: sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-fix-setxattr-client10 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features mon_bind_addrvec: false mon_bind_msgr2: false sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 754758768dacbb43223ce6879371b1e2ab6a4c92 owner: scheduled_sidharthanup@teuthology priority: 105 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - client.1 sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_octopus/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 754758768dacbb43223ce6879371b1e2ab6a4c92 tasks: - install: branch: mimic exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-diskprediction-cloud - ceph-mgr-rook - ceph-mgr-cephadm - cephadm extra_packages: - librados2 - print: '**** done installing mimic' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-whitelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon mon_bind_addrvec: false mon_bind_msgr2: false - exec: osd.0: - ceph osd require-osd-release mimic - ceph osd set-require-min-compat-client mimic - print: '**** done ceph' - workunit: clients: client.0: - fs/upgrade/volume_client env: ACTION: create - print: '**** fs/volume_client create' - ceph-fuse: client.0: auth_id: vol_data_isolated mount_path: /volumes/_nogroup/vol_isolated mountpoint: mnt.0 client.1: auth_id: vol_default mount_path: /volumes/_nogroup/vol_default mountpoint: mnt.1 - print: '**** ceph-fuse vol_isolated' - workunit: cleanup: false clients: client.0: - fs/upgrade/volume_client env: ACTION: populate - workunit: cleanup: false clients: client.1: - fs/upgrade/volume_client env: ACTION: populate - print: '**** fs/volume_client populate' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - exec: mon.a: - ceph config set global mon_warn_on_msgr2_not_enabled false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph mon enable-msgr2 - ceph versions - ceph osd dump -f json-pretty - ceph config rm global mon_warn_on_msgr2_not_enabled - ceph osd require-osd-release octopus - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs volume ls - ceph fs subvolume ls cephfs - workunit: cleanup: false clients: client.0: - fs/upgrade/volume_client env: ACTION: verify - workunit: cleanup: false clients: client.1: - fs/upgrade/volume_client env: ACTION: verify - print: '**** fs/volume_client verify' teuthology_branch: master tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.20770 2020-07-06T13:09:04.411 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_octopus/qa; will attempt to use it 2020-07-06T13:09:04.412 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_octopus/qa/tasks 2020-07-06T13:09:04.412 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-07-06T13:09:04.414 INFO:teuthology.task.internal:Checking packages... 2020-07-06T13:09:04.436 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'dd8f1a544d5c98277d42ecace4dad854c428b262' 2020-07-06T13:09:04.437 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-06T13:09:04.437 INFO:teuthology.packaging:ref: None 2020-07-06T13:09:04.437 INFO:teuthology.packaging:tag: None 2020-07-06T13:09:04.438 INFO:teuthology.packaging:branch: wip-fix-setxattr-client10 2020-07-06T13:09:04.438 INFO:teuthology.packaging:sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:09:04.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-fix-setxattr-client10 2020-07-06T13:09:04.617 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:09:04.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-07-06T13:09:04.634 INFO:teuthology.task.internal:no buildpackages task found 2020-07-06T13:09:04.635 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-07-06T13:09:04.674 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-07-06T13:09:04.674 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-06T13:09:04.733 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-06T13:09:14.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-06T13:09:24.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-06T13:09:34.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-06T13:09:44.803 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_sidharthanup@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029'} 2020-07-06T13:09:44.828 DEBUG:teuthology.lock.ops:locked ubuntu@smithi118.front.sepia.ceph.com, ubuntu@smithi148.front.sepia.ceph.com 2020-07-06T13:09:44.879 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06d9fc5d08>, signals=[15]) 2020-07-06T13:09:45.089 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 18.04 2020-07-06T13:09:45.092 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 18.04 2020-07-06T13:09:45.478 INFO:teuthology.orchestra.console:Power off smithi148 2020-07-06T13:09:45.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-06T13:09:45.502 INFO:teuthology.orchestra.console:Power off smithi118 2020-07-06T13:09:45.503 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-06T13:09:45.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:45.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:49.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:49.559 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:53.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:53.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:53.878 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2020-07-06T13:09:53.889 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2020-07-06T13:09:53.980 INFO:teuthology.orchestra.console:Power on smithi148 2020-07-06T13:09:53.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-06T13:09:53.994 INFO:teuthology.orchestra.console:Power on smithi118 2020-07-06T13:09:53.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-06T13:09:54.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:54.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:58.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:58.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:09:58.285 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2020-07-06T13:09:58.387 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2020-07-06T13:10:02.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-06T13:10:02.388 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2020-07-06T13:10:02.489 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2020-07-06T13:12:59.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:03.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:08.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:12.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:17.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:21.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:26.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:30.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:39.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:49.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:54.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:13:58.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:14:07.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:00.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:00.198 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-06T13:15:00.200 INFO:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-06T13:15:00.591 INFO:teuthology.provision.fog.smithi118:Node is ready 2020-07-06T13:15:00.592 INFO:teuthology.orchestra.run.smithi118:> hostname 2020-07-06T13:15:00.643 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2020-07-06T13:15:00.644 INFO:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2020-07-06T13:15:00.693 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2020-07-06T13:15:00.693 INFO:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2020-07-06T13:15:00.806 INFO:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2020-07-06T13:15:00.818 INFO:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2020-07-06T13:15:00.876 INFO:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2020-07-06T13:15:00.933 INFO:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2020-07-06T13:15:00.988 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2020-07-06T13:15:00.989 DEBUG:teuthology.parallel:result is None 2020-07-06T13:15:13.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:13.249 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-06T13:15:13.249 INFO:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-06T13:15:13.599 INFO:teuthology.provision.fog.smithi148:Node is ready 2020-07-06T13:15:13.600 INFO:teuthology.orchestra.run.smithi148:> hostname 2020-07-06T13:15:13.645 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2020-07-06T13:15:13.646 INFO:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2020-07-06T13:15:13.694 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2020-07-06T13:15:13.695 INFO:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2020-07-06T13:15:13.829 INFO:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2020-07-06T13:15:13.843 INFO:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2020-07-06T13:15:13.900 INFO:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2020-07-06T13:15:13.953 INFO:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2020-07-06T13:15:14.008 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2020-07-06T13:15:14.009 DEBUG:teuthology.parallel:result is None 2020-07-06T13:15:14.140 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2020-07-06T13:15:14.142 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-06T13:15:14.162 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2020-07-06T13:15:14.163 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-06T13:15:14.181 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2020-07-06T13:15:14.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-06T13:15:14.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:14.258 INFO:teuthology.orchestra.run.smithi118:> true 2020-07-06T13:15:14.503 INFO:teuthology.orchestra.run.smithi118:> uname -m 2020-07-06T13:15:14.551 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2020-07-06T13:15:14.551 INFO:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2020-07-06T13:15:14.599 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2020-07-06T13:15:14.599 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-07-06T13:15:14.600 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2020-07-06T13:15:14.600 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2020-07-06T13:15:14.600 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-07-06T13:15:14.600 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="18.04" 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=bionic 2020-07-06T13:15:14.601 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=bionic 2020-07-06T13:15:14.603 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2020-07-06T13:15:14.624 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2020-07-06T13:15:14.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-06T13:15:14.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:14.698 INFO:teuthology.orchestra.run.smithi148:> true 2020-07-06T13:15:14.894 INFO:teuthology.orchestra.run.smithi148:> uname -m 2020-07-06T13:15:14.942 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2020-07-06T13:15:14.943 INFO:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2020-07-06T13:15:14.989 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="18.04" 2020-07-06T13:15:14.990 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2020-07-06T13:15:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-07-06T13:15:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-07-06T13:15:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-07-06T13:15:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=bionic 2020-07-06T13:15:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=bionic 2020-07-06T13:15:14.992 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2020-07-06T13:15:15.014 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-07-06T13:15:15.044 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCuuNMfx60q5HPmA0HLt+CUwSRWWBShmYc/O6WqWciNvSr/Xyfl0/pTWo3FjMEM6WOBAqQeD88dyke8rxsQ7iqxoLU5QZIW2cVs3CAm40lmcZYQ5Yp90za2PaL7dUwFo8ZVBc+MK6i0AgbPDw+/x82yDhR7y2pmqJU8RMqqc/8GycR9mj9RofxmUuoBc+lxjaY0ORYWZfvlHEQS1WVIBB48hGFa2wxxeVhbt+JY6i6XvyaAodyCN1JruK/RAWJ0jf9vleeBHxMhsiGlzfYQTFuZ3DumRB77MJTjRLXZFGbknZlCwLE5QYL6CTLa/8N9E+EB4CrS0+wcSz+F0FopjZAn smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyaOL/u5Ris9lw1L3iqOMVxnx5BV6286yHgnniVTmV9kWw7HqjPIJWL/lgm4YSOWB2juUH2rQCrCDycs+F74GwcPejx24oTInYlioBQuCGN4Ba2lZISZskpgJPN4IEujI4XQLpjEfN/PsBN9bbFakNHuDDGjaFoBNNEdnthkuV+eSSQSJ09eXNPOVc+8JXYRKstXhJN0jLvcgW4kPFzR6078WXBgzoPLtOFQ9qvC+j0sAc/dxkEbhf/+ad6bMwlgujouVUSgFRSjT2J5t/pzVh07gApO+6kDB9tYwkfEdQvzItHqOcpHL8Cy0d9KztOqfs3PpCkjGKQd2Yr9+JK5SL 2020-07-06T13:15:15.045 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-06T13:15:15.097 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-07-06T13:15:15.106 INFO:teuthology.task.internal:Saving configuration 2020-07-06T13:15:15.133 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-07-06T13:15:15.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-07-06T13:15:15.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-06 13:09:44.812153', 'description': '/home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029', 'locked_by': 'scheduled_sidharthanup@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPxGEacI3RgVAToZ8juVZEc18j5JfefPTl0FsVk8XsjC', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi118.front.sepia.ceph.com'} 2020-07-06T13:15:15.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-06 13:09:44.812174', 'description': '/home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029', 'locked_by': 'scheduled_sidharthanup@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIORUHbFFNAIvP1fmKU79mck46+CC+iFB2vx0YDEIKVM+', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi148.front.sepia.ceph.com'} 2020-07-06T13:15:15.175 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-07-06T13:15:15.190 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-07-06T13:15:15.191 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['client.0', 'client.1'] 2020-07-06T13:15:15.191 INFO:teuthology.run_tasks:Running task console_log... 2020-07-06T13:15:15.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06da000950>, signals=[15]) 2020-07-06T13:15:15.268 INFO:teuthology.run_tasks:Running task internal.connect... 2020-07-06T13:15:15.278 INFO:teuthology.task.internal:Opening connections... 2020-07-06T13:15:15.279 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:15:15.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:15.356 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2020-07-06T13:15:15.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:15:15.494 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-07-06T13:15:15.514 INFO:teuthology.orchestra.run.smithi118:> uname -m 2020-07-06T13:15:15.550 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2020-07-06T13:15:15.550 INFO:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2020-07-06T13:15:15.599 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2020-07-06T13:15:15.599 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-07-06T13:15:15.599 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2020-07-06T13:15:15.600 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2020-07-06T13:15:15.600 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-07-06T13:15:15.600 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="18.04" 2020-07-06T13:15:15.600 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2020-07-06T13:15:15.600 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-07-06T13:15:15.601 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-07-06T13:15:15.601 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-07-06T13:15:15.601 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=bionic 2020-07-06T13:15:15.601 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=bionic 2020-07-06T13:15:15.602 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2020-07-06T13:15:15.627 INFO:teuthology.orchestra.run.smithi148:> uname -m 2020-07-06T13:15:15.684 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2020-07-06T13:15:15.685 INFO:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2020-07-06T13:15:15.733 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2020-07-06T13:15:15.733 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-07-06T13:15:15.734 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2020-07-06T13:15:15.734 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2020-07-06T13:15:15.734 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-07-06T13:15:15.734 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="18.04" 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=bionic 2020-07-06T13:15:15.735 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=bionic 2020-07-06T13:15:15.736 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2020-07-06T13:15:15.756 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-07-06T13:15:15.774 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-07-06T13:15:15.785 INFO:teuthology.task.internal:Checking for old test directory... 2020-07-06T13:15:15.786 INFO:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2020-07-06T13:15:15.789 INFO:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2020-07-06T13:15:15.794 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-07-06T13:15:15.804 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-07-06T13:15:15.804 INFO:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2020-07-06T13:15:15.835 INFO:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2020-07-06T13:15:15.856 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-07-06T13:15:15.912 INFO:teuthology.run_tasks:Running task kernel... 2020-07-06T13:15:15.932 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}} 2020-07-06T13:15:15.933 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-07-06T13:15:15.933 INFO:teuthology.orchestra.run.smithi118:> uname -r 2020-07-06T13:15:15.940 INFO:teuthology.orchestra.run.smithi118.stdout:4.15.0-109-generic 2020-07-06T13:15:15.940 INFO:teuthology.task.kernel:Running kernel on smithi118: 4.15.0-109-generic 2020-07-06T13:15:15.941 INFO:teuthology.orchestra.run.smithi118:> sudo apt-get clean 2020-07-06T13:15:16.024 INFO:teuthology.orchestra.run.smithi118:> sudo apt-get update 2020-07-06T13:15:16.320 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-07-06T13:15:16.339 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-07-06T13:15:16.403 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-07-06T13:15:16.668 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-07-06T13:15:16.719 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [499 kB] 2020-07-06T13:15:16.859 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [709 kB] 2020-07-06T13:15:17.025 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [774 kB] 2020-07-06T13:15:17.162 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,001 kB] 2020-07-06T13:15:17.285 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [338 kB] 2020-07-06T13:15:17.312 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [74.9 kB] 2020-07-06T13:15:17.323 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [16.8 kB] 2020-07-06T13:15:17.324 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-06T13:15:17.447 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] 2020-07-06T13:15:17.494 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [339 kB] 2020-07-06T13:15:18.042 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 6,116 kB in 2s (3,566 kB/s) 2020-07-06T13:15:19.470 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:15:19.517 INFO:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-07-06T13:15:19.592 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:15:19.813 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2020-07-06T13:15:19.814 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2020-07-06T13:15:19.889 INFO:teuthology.orchestra.run.smithi118.stderr:E: Unable to locate package linux-image-current-generic 2020-07-06T13:15:19.891 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-07-06T13:15:19.891 INFO:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-07-06T13:15:19.969 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:15:20.230 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2020-07-06T13:15:20.231 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2020-07-06T13:15:20.444 INFO:teuthology.orchestra.run.smithi118.stdout:linux-image-generic is already the newest version (4.15.0.109.97). 2020-07-06T13:15:20.445 INFO:teuthology.orchestra.run.smithi118.stdout:linux-image-generic set to manually installed. 2020-07-06T13:15:20.445 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-06T13:15:20.446 INFO:teuthology.orchestra.run.smithi118:> dpkg -s linux-image-generic 2020-07-06T13:15:20.464 INFO:teuthology.orchestra.run.smithi118.stdout:Package: linux-image-generic 2020-07-06T13:15:20.464 INFO:teuthology.orchestra.run.smithi118.stdout:Status: install ok installed 2020-07-06T13:15:20.464 INFO:teuthology.orchestra.run.smithi118.stdout:Priority: optional 2020-07-06T13:15:20.465 INFO:teuthology.orchestra.run.smithi118.stdout:Section: kernel 2020-07-06T13:15:20.465 INFO:teuthology.orchestra.run.smithi118.stdout:Installed-Size: 16 2020-07-06T13:15:20.465 INFO:teuthology.orchestra.run.smithi118.stdout:Maintainer: Ubuntu Kernel Team 2020-07-06T13:15:20.465 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: amd64 2020-07-06T13:15:20.465 INFO:teuthology.orchestra.run.smithi118.stdout:Source: linux-meta 2020-07-06T13:15:20.466 INFO:teuthology.orchestra.run.smithi118.stdout:Version: 4.15.0.109.97 2020-07-06T13:15:20.466 INFO:teuthology.orchestra.run.smithi118.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.9) 2020-07-06T13:15:20.466 INFO:teuthology.orchestra.run.smithi118.stdout:Depends: linux-image-4.15.0-109-generic, linux-modules-extra-4.15.0-109-generic, linux-firmware, intel-microcode, amd64-microcode 2020-07-06T13:15:20.466 INFO:teuthology.orchestra.run.smithi118.stdout:Recommends: thermald 2020-07-06T13:15:20.466 INFO:teuthology.orchestra.run.smithi118.stdout:Description: Generic Linux kernel image 2020-07-06T13:15:20.467 INFO:teuthology.orchestra.run.smithi118.stdout: This package will always depend on the latest generic kernel image 2020-07-06T13:15:20.467 INFO:teuthology.orchestra.run.smithi118.stdout: available. 2020-07-06T13:15:20.467 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-06T13:15:20.467 INFO:teuthology.orchestra.run.smithi148:> uname -r 2020-07-06T13:15:20.473 INFO:teuthology.orchestra.run.smithi148.stdout:4.15.0-109-generic 2020-07-06T13:15:20.473 INFO:teuthology.task.kernel:Running kernel on smithi148: 4.15.0-109-generic 2020-07-06T13:15:20.474 INFO:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2020-07-06T13:15:20.661 INFO:teuthology.orchestra.run.smithi148:> sudo apt-get update 2020-07-06T13:15:20.935 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-07-06T13:15:20.935 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-07-06T13:15:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-07-06T13:15:21.271 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-07-06T13:15:21.359 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [499 kB] 2020-07-06T13:15:21.498 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,001 kB] 2020-07-06T13:15:21.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [774 kB] 2020-07-06T13:15:21.842 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [709 kB] 2020-07-06T13:15:21.882 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [338 kB] 2020-07-06T13:15:21.900 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [74.9 kB] 2020-07-06T13:15:21.924 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [16.8 kB] 2020-07-06T13:15:21.926 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-06T13:15:21.980 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] 2020-07-06T13:15:22.016 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [339 kB] 2020-07-06T13:15:22.670 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 6,116 kB in 2s (3,442 kB/s) 2020-07-06T13:15:24.075 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2020-07-06T13:15:24.122 INFO:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-07-06T13:15:24.201 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2020-07-06T13:15:24.434 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2020-07-06T13:15:24.435 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2020-07-06T13:15:24.511 INFO:teuthology.orchestra.run.smithi148.stderr:E: Unable to locate package linux-image-current-generic 2020-07-06T13:15:24.513 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-07-06T13:15:24.513 INFO:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-07-06T13:15:24.589 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2020-07-06T13:15:24.810 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2020-07-06T13:15:24.811 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2020-07-06T13:15:25.005 INFO:teuthology.orchestra.run.smithi148.stdout:linux-image-generic is already the newest version (4.15.0.109.97). 2020-07-06T13:15:25.006 INFO:teuthology.orchestra.run.smithi148.stdout:linux-image-generic set to manually installed. 2020-07-06T13:15:25.006 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-06T13:15:25.007 INFO:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2020-07-06T13:15:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2020-07-06T13:15:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2020-07-06T13:15:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2020-07-06T13:15:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 16 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 4.15.0.109.97 2020-07-06T13:15:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.9) 2020-07-06T13:15:25.031 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-4.15.0-109-generic, linux-modules-extra-4.15.0-109-generic, linux-firmware, intel-microcode, amd64-microcode 2020-07-06T13:15:25.031 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2020-07-06T13:15:25.031 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2020-07-06T13:15:25.031 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2020-07-06T13:15:25.031 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2020-07-06T13:15:25.032 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-06T13:15:25.032 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-07-06T13:15:25.032 INFO:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-06T13:15:25.047 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2020-07-06T13:15:25.073 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2020-07-06T13:15:25.074 INFO:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-06T13:15:25.098 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2020-07-06T13:15:25.122 INFO:teuthology.run_tasks:Running task internal.base... 2020-07-06T13:15:25.132 INFO:teuthology.task.internal:Creating test directory... 2020-07-06T13:15:25.133 INFO:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-06T13:15:25.137 INFO:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-06T13:15:25.169 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-07-06T13:15:25.190 INFO:teuthology.run_tasks:Running task internal.archive... 2020-07-06T13:15:25.214 INFO:teuthology.task.internal:Creating archive directory... 2020-07-06T13:15:25.216 INFO:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-06T13:15:25.219 INFO:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-06T13:15:25.242 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-07-06T13:15:25.254 INFO:teuthology.task.internal:Enabling coredump saving... 2020-07-06T13:15:25.254 INFO:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-06T13:15:25.287 INFO:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-06T13:15:25.309 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-06T13:15:25.311 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-06T13:15:25.316 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-06T13:15:25.319 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-06T13:15:25.322 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-07-06T13:15:25.332 INFO:teuthology.task.internal:Configuring sudo... 2020-07-06T13:15:25.332 INFO:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-06T13:15:25.363 INFO:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-06T13:15:25.380 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-07-06T13:15:25.393 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-07-06T13:15:25.394 INFO:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-06T13:15:25.424 INFO:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-06T13:15:25.431 INFO:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-06T13:15:25.475 INFO:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-06T13:15:25.524 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-06T13:15:25.612 INFO:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-06T13:15:25.620 INFO:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-06T13:15:25.670 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-06T13:15:25.758 INFO:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2020-07-06T13:15:25.761 INFO:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2020-07-06T13:15:25.838 INFO:teuthology.run_tasks:Running task internal.timer... 2020-07-06T13:15:25.849 INFO:teuthology.task.internal:Starting timer... 2020-07-06T13:15:25.849 INFO:teuthology.run_tasks:Running task pcp... 2020-07-06T13:15:25.866 INFO:teuthology.run_tasks:Running task selinux... 2020-07-06T13:15:25.883 DEBUG:teuthology.task.selinux:Excluding smithi118: OS 'ubuntu' does not support SELinux 2020-07-06T13:15:25.883 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2020-07-06T13:15:25.884 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-07-06T13:15:25.884 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-07-06T13:15:25.884 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-07-06T13:15:25.884 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-07-06T13:15:25.904 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-07-06T13:15:25.919 INFO:teuthology.repo_utils:Fetching master from origin 2020-07-06T13:15:25.981 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-07-06T13:15:26.003 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-07-06T13:15:26.005 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-07-06T13:15:26.411 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-07-06T13:15:27.496 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-07-06T13:15:29.963 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-07-06T13:15:29.988 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:29 +0000 (0:00:00.087) 0:00:00.087 *********** 2020-07-06T13:15:30.006 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:30 +0000 (0:00:00.017) 0:00:00.104 *********** 2020-07-06T13:15:31.838 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi118.front.sepia.ceph.com] 2020-07-06T13:15:31.917 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:31 +0000 (0:00:01.911) 0:00:02.016 *********** 2020-07-06T13:15:32.320 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-07-06T13:15:32.321 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-07-06T13:15:32.364 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:32 +0000 (0:00:00.447) 0:00:02.463 *********** 2020-07-06T13:15:32.848 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi148.front.sepia.ceph.com] 2020-07-06T13:15:32.923 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:32 +0000 (0:00:00.558) 0:00:03.022 *********** 2020-07-06T13:15:32.990 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-06T13:15:32.992 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-06T13:15:33.139 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.215) 0:00:03.237 *********** 2020-07-06T13:15:33.148 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-07-06T13:15:33.150 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-07-06T13:15:33.187 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.048) 0:00:03.286 *********** 2020-07-06T13:15:33.532 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-07-06T13:15:33.534 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.090398", "end": "2020-07-06 13:15:33.744462", "rc": 0, "start": "2020-07-06 13:15:33.654064", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-07-06T13:15:33.569 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.381) 0:00:03.667 *********** 2020-07-06T13:15:33.614 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-06T13:15:33.622 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-06T13:15:33.653 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.083) 0:00:03.751 *********** 2020-07-06T13:15:33.866 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-07-06T13:15:33.868 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [ansible-managed : Delete the ansible users password.] ******************** changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.073234", "end": "2020-07-06 13:15:34.072520", "rc": 0, "start": "2020-07-06 13:15:33.999286", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-07-06T13:15:33.914 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.261) 0:00:04.013 *********** 2020-07-06T13:15:33.952 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:33 +0000 (0:00:00.037) 0:00:04.051 *********** 2020-07-06T13:15:34.104 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-07-06T13:15:34.106 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:15:34.141 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:34 +0000 (0:00:00.188) 0:00:04.239 *********** 2020-07-06T13:15:34.799 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-07-06T13:15:34.801 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594041333.933125-186138417006275/source", "state": "file", "uid": 0} 2020-07-06T13:15:34.803 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594041334.1598766-200903643546795/source", "state": "file", "uid": 0} 2020-07-06T13:15:34.842 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:34 +0000 (0:00:00.701) 0:00:04.940 *********** 2020-07-06T13:15:34.882 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:34 +0000 (0:00:00.039) 0:00:04.980 *********** 2020-07-06T13:15:35.187 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-07-06T13:15:35.189 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-06T13:15:35.191 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-06T13:15:35.224 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-06T13:15:35.226 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-06T13:15:35.342 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-07-06T13:15:35.345 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-07-06T13:15:35.486 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:35 +0000 (0:00:00.604) 0:00:05.585 *********** 2020-07-06T13:15:35.523 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:35 +0000 (0:00:00.036) 0:00:05.621 *********** 2020-07-06T13:15:36.276 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi148.front.sepia.ceph.com] 2020-07-06T13:15:36.349 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-07-06T13:15:36.351 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:36 +0000 (0:00:00.827) 0:00:06.448 *********** 2020-07-06T13:15:36.744 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-06T13:15:36.747 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.176170", "end": "2020-07-06 13:15:36.721005", "rc": 0, "start": "2020-07-06 13:15:36.544835", "stderr": "", "stderr_lines": [], "stdout": "e6b1f068038ee25eb6abdeb9a4c484f83957c32b", "stdout_lines": ["e6b1f068038ee25eb6abdeb9a4c484f83957c32b"]} 2020-07-06T13:15:36.787 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:36 +0000 (0:00:00.437) 0:00:06.885 *********** 2020-07-06T13:15:36.938 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-07-06T13:15:36.940 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014728", "end": "2020-07-06 13:15:37.150713", "failed_when_result": false, "rc": 0, "start": "2020-07-06 13:15:37.135985", "stderr": "", "stderr_lines": [], "stdout": "e6b1f068038ee25eb6abdeb9a4c484f83957c32b", "stdout_lines": ["e6b1f068038ee25eb6abdeb9a4c484f83957c32b"]} 2020-07-06T13:15:36.976 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:36 +0000 (0:00:00.189) 0:00:07.074 *********** 2020-07-06T13:15:37.016 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-07-06T13:15:37.018 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-07-06T13:15:37.062 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.085) 0:00:07.160 *********** 2020-07-06T13:15:37.093 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-07-06T13:15:37.095 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.132 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.070) 0:00:07.230 *********** 2020-07-06T13:15:37.161 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-07-06T13:15:37.163 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.197 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.065) 0:00:07.296 *********** 2020-07-06T13:15:37.227 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-07-06T13:15:37.229 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.230 INFO:teuthology.task.ansible.out: 2020-07-06T13:15:37.231 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* ok: [smithi118.front.sepia.ceph.com] 2020-07-06T13:15:37.294 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.096) 0:00:07.392 *********** 2020-07-06T13:15:37.347 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.052) 0:00:07.445 *********** 2020-07-06T13:15:37.356 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-07-06T13:15:37.358 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.396 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.049) 0:00:07.494 *********** 2020-07-06T13:15:37.447 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-07-06T13:15:37.449 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.486 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.090) 0:00:07.585 *********** 2020-07-06T13:15:37.557 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:37.560 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.562 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.586 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.594 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.595 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.596 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAA 2020-07-06T13:15:37.598 INFO:teuthology.task.ansible.out:AADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.607 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.609 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.618 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.620 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.636 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.652 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.666 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.668 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.679 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.681 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.691 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.694 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.696 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.706 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.707 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.718 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.730 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.741 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.751 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.753 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.763 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.774 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.776 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.786 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-06T13:15:37.787 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.189524", "end": "2020-07-06 13:15:37.754434", "rc": 0, "start": "2020-07-06 13:15:37.564910", "stderr": "", "stderr_lines": [], "stdout": "e6b1f068038ee25eb6abdeb9a4c484f83957c32b", "stdout_lines": ["e6b1f068038ee25eb6abdeb9a4c484f83957c32b"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.848 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:37 +0000 (0:00:00.358) 0:00:07.943 *********** 2020-07-06T13:15:37.855 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.856 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.857 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.857 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "ite 2020-07-06T13:15:37.859 INFO:teuthology.task.ansible.out:m": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.860 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] 2020-07-06T13:15:37.861 INFO:teuthology.task.ansible.out:=> (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.871 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.873 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.883 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.885 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.895 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.896 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.906 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.907 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.918 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.920 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.930 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.931 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.941 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.962 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.964 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.974 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.976 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:37.997 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006760", "end": "2020-07-06 13:15:38.218665", "failed_when_result": false, "rc": 0, "start": "2020-07-06 13:15:38.211905", "stderr": "", "stderr_lines": [], "stdout": "e6b1f068038ee25eb6abdeb9a4c484f83957c32b", "stdout_lines": ["e6b1f068038ee25eb6abdeb9a4c484f83957c32b"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.033 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.188) 0:00:08.132 *********** 2020-07-06T13:15:38.043 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.044 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.045 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.045 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.046 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1f 2020-07-06T13:15:38.047 INFO:teuthology.task.ansible.out:b0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.048 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {" 2020-07-06T13:15:38.049 INFO:teuthology.task.ansible.out:name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.059 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.061 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.071 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.073 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.073 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.129 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.095) 0:00:08.228 *********** 2020-07-06T13:15:38.140 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.142 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.143 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.143 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": 2020-07-06T13:15:38.145 INFO:teuthology.task.ansible.out:"ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3a 2020-07-06T13:15:38.147 INFO:teuthology.task.ansible.out:db8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.156 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.158 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.202 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.066) 0:00:08.294 *********** 2020-07-06T13:15:38.206 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.208 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyr 2020-07-06T13:15:38.210 INFO:teuthology.task.ansible.out:atsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.234 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.236 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-07-06T13:15:38.237 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.272 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.075) 0:00:08.369 *********** 2020-07-06T13:15:38.311 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.040) 0:00:08.410 *********** 2020-07-06T13:15:38.321 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-07-06T13:15:38.322 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.361 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.049) 0:00:08.460 *********** 2020-07-06T13:15:38.374 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-06T13:15:38.416 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.054) 0:00:08.514 *********** 2020-07-06T13:15:38.425 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-07-06T13:15:38.427 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.467 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.051) 0:00:08.565 *********** 2020-07-06T13:15:38.477 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.523 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.055) 0:00:08.621 *********** 2020-07-06T13:15:38.533 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-07-06T13:15:38.535 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.572 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.049) 0:00:08.671 *********** 2020-07-06T13:15:38.583 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-06T13:15:38.585 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.623 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.050) 0:00:08.721 *********** 2020-07-06T13:15:38.634 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.636 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.646 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.648 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr 2020-07-06T13:15:38.649 INFO:teuthology.task.ansible.out:+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.659 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-07-06T13:15:38.661 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.705 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.082) 0:00:08.803 *********** 2020-07-06T13:15:38.717 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.718 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.719 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2020-07-06T13:15:38.720 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6I 2020-07-06T13:15:38.722 INFO:teuthology.task.ansible.out:nynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8 2020-07-06T13:15:38.724 INFO:teuthology.task.ansible.out:595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu 2020-07-06T13:15:38.725 INFO:teuthology.task.ansible.out:16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.734 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.735 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.736 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.780 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.075) 0:00:08.879 *********** 2020-07-06T13:15:38.806 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef 2020-07-06T13:15:38.808 INFO:teuthology.task.ansible.out:168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front. 2020-07-06T13:15:38.810 INFO:teuthology.task.ansible.out:sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw e 2020-07-06T13:15:38.811 INFO:teuthology.task.ansible.out:e37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.812 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item 2020-07-06T13:15:38.814 INFO:teuthology.task.ansible.out:": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.824 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.834 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-07-06T13:15:38.836 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.875 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:38 +0000 (0:00:00.094) 0:00:08.973 *********** 2020-07-06T13:15:38.884 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.886 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.887 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.887 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'ow 2020-07-06T13:15:38.889 INFO:teuthology.task.ansible.out:asserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dd 2020-07-06T13:15:38.891 INFO:teuthology.task.ansible.out:e844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.902 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.904 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.915 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.917 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.934 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.940 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.941 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.942 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.944 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.946 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.955 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.957 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.957 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.968 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-06T13:15:38.970 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.971 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.981 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:38.983 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:38.998 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.006 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-06T13:15:39.008 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.019 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.021 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.031 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.034 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.043 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.045 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.055 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.057 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.068 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.070 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.081 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.084 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.092 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.094 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.104 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.106 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.125 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'sjust', ' 2020-07-06T13:15:39.127 INFO:teuthology.task.ansible.out:ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.131 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.141 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.143 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a19 2020-07-06T13:15:39.145 INFO:teuthology.task.ansible.out:64a"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.148 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-06T13:15:39.150 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.194 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.318) 0:00:09.292 *********** 2020-07-06T13:15:39.204 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.206 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.207 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.210 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.222 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.225 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.235 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.238 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.248 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.250 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.259 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.273 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek 2020-07-06T13:15:39.276 INFO:teuthology.task.ansible.out:", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.284 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.294 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.310 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.318 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.364 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.170) 0:00:09.462 *********** 2020-07-06T13:15:39.395 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-06T13:15:39.446 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.082) 0:00:09.544 *********** 2020-07-06T13:15:39.478 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.522 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.075) 0:00:09.620 *********** 2020-07-06T13:15:39.563 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-06T13:15:39.565 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.602 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.080) 0:00:09.700 *********** 2020-07-06T13:15:39.649 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.707 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.105) 0:00:09.805 *********** 2020-07-06T13:15:39.754 INFO:teuthology.task.ansible.out: 2020-07-06T13:15:39.756 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.794 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.087) 0:00:09.893 *********** 2020-07-06T13:15:39.795 INFO:teuthology.task.ansible.out: 2020-07-06T13:15:39.837 INFO:teuthology.task.ansible.out: 2020-07-06T13:15:39.838 INFO:teuthology.task.ansible.out:TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.878 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.083) 0:00:09.977 *********** 2020-07-06T13:15:39.880 INFO:teuthology.task.ansible.out: 2020-07-06T13:15:39.889 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-07-06T13:15:39.891 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "f94aefe93819137d6cc7907b1389aa0477ea6681", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-07-06T13:15:39.933 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:39 +0000 (0:00:00.054) 0:00:10.031 *********** 2020-07-06T13:15:39.943 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-06T13:15:39.945 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.947 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.959 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.960 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:39.970 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-06T13:15:39.973 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => { "msg": "Host smithi148.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Remove revoked users] ******************************************** skipping: [smithi118.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.021 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.087) 0:00:10.119 *********** 2020-07-06T13:15:40.032 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.034 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.035 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.035 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.036 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.048 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.049 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.050 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.062 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.064 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi148.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-07-06T13:15:40.101 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.080) 0:00:10.200 *********** 2020-07-06T13:15:40.111 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-06T13:15:40.113 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.114 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.115 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.115 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.115 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.116 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.116 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.117 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.117 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.133 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.180 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.078) 0:00:10.279 *********** 2020-07-06T13:15:40.190 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-07-06T13:15:40.192 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.249 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.068) 0:00:10.348 *********** 2020-07-06T13:15:40.281 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-07-06T13:15:40.283 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.318 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.069) 0:00:10.417 *********** 2020-07-06T13:15:40.360 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-07-06T13:15:40.362 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.398 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.079) 0:00:10.497 *********** 2020-07-06T13:15:40.430 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-06T13:15:40.431 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.474 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.075) 0:00:10.573 *********** 2020-07-06T13:15:40.507 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-07-06T13:15:40.509 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.548 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.073) 0:00:10.646 *********** 2020-07-06T13:15:40.557 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-07-06T13:15:40.558 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "f94aefe93819137d6cc7907b1389aa0477ea6681", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-07-06T13:15:40.597 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.049) 0:00:10.696 *********** 2020-07-06T13:15:40.610 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.650 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.052) 0:00:10.748 *********** 2020-07-06T13:15:40.660 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-06T13:15:40.661 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => { "msg": "Host smithi118.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-07-06T13:15:40.701 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.050) 0:00:10.799 *********** 2020-07-06T13:15:40.710 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-06T13:15:40.712 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.752 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.049) 0:00:10.848 *********** 2020-07-06T13:15:40.761 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-07-06T13:15:40.763 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-07-06T13:15:40.800 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.050) 0:00:10.899 *********** 2020-07-06T13:15:40.811 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-07-06T13:15:40.812 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.852 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.051) 0:00:10.951 *********** 2020-07-06T13:15:40.862 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-07-06T13:15:40.863 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:40.903 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.050) 0:00:11.001 *********** 2020-07-06T13:15:40.913 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-07-06T13:15:40.914 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:40.965 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:40 +0000 (0:00:00.062) 0:00:11.064 *********** 2020-07-06T13:15:40.977 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-07-06T13:15:40.979 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.016 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.050) 0:00:11.115 *********** 2020-07-06T13:15:41.028 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-06T13:15:41.030 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.073 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.056) 0:00:11.171 *********** 2020-07-06T13:15:41.085 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.127 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.053) 0:00:11.225 *********** 2020-07-06T13:15:41.136 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-07-06T13:15:41.138 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.186 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.058) 0:00:11.284 *********** 2020-07-06T13:15:41.194 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-06T13:15:41.201 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.236 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.050) 0:00:11.334 *********** 2020-07-06T13:15:41.245 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-07-06T13:15:41.247 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:41.284 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.048) 0:00:11.382 *********** 2020-07-06T13:15:41.298 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.333 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.048) 0:00:11.431 *********** 2020-07-06T13:15:41.342 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-07-06T13:15:41.344 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.382 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.481 *********** 2020-07-06T13:15:41.394 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-07-06T13:15:41.396 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.432 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.530 *********** 2020-07-06T13:15:41.442 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-06T13:15:41.444 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:41.481 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.580 *********** 2020-07-06T13:15:41.491 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-06T13:15:41.493 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.530 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.048) 0:00:11.629 *********** 2020-07-06T13:15:41.540 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-07-06T13:15:41.542 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.585 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.055) 0:00:11.684 *********** 2020-07-06T13:15:41.596 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-07-06T13:15:41.598 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.635 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.733 *********** 2020-07-06T13:15:41.647 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-06T13:15:41.652 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.686 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.051) 0:00:11.785 *********** 2020-07-06T13:15:41.696 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-07-06T13:15:41.698 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:41.736 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.834 *********** 2020-07-06T13:15:41.748 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.789 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.053) 0:00:11.887 *********** 2020-07-06T13:15:41.799 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-06T13:15:41.801 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.839 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.050) 0:00:11.937 *********** 2020-07-06T13:15:41.849 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-07-06T13:15:41.851 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.889 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.049) 0:00:11.987 *********** 2020-07-06T13:15:41.899 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-07-06T13:15:41.901 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:41.939 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.050) 0:00:12.038 *********** 2020-07-06T13:15:41.950 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-07-06T13:15:41.953 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:41.991 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:41 +0000 (0:00:00.051) 0:00:12.089 *********** 2020-07-06T13:15:42.004 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-07-06T13:15:42.010 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:42.045 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.054) 0:00:12.144 *********** 2020-07-06T13:15:42.056 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-06T13:15:42.058 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.102 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.057) 0:00:12.201 *********** 2020-07-06T13:15:42.118 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.151 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.048) 0:00:12.249 *********** 2020-07-06T13:15:42.163 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-07-06T13:15:42.165 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.203 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.052) 0:00:12.302 *********** 2020-07-06T13:15:42.213 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-06T13:15:42.215 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:42.253 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.049) 0:00:12.351 *********** 2020-07-06T13:15:42.271 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.308 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.055) 0:00:12.406 *********** 2020-07-06T13:15:42.318 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-07-06T13:15:42.319 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.356 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.047) 0:00:12.454 *********** 2020-07-06T13:15:42.366 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-06T13:15:42.368 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.405 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.048) 0:00:12.503 *********** 2020-07-06T13:15:42.413 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-06T13:15:42.415 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.467 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.062) 0:00:12.565 *********** 2020-07-06T13:15:42.479 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.532 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.064) 0:00:12.630 *********** 2020-07-06T13:15:42.541 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-07-06T13:15:42.543 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.580 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.048) 0:00:12.678 *********** 2020-07-06T13:15:42.590 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-07-06T13:15:42.591 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.628 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.047) 0:00:12.726 *********** 2020-07-06T13:15:42.637 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-07-06T13:15:42.639 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.676 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.048) 0:00:12.774 *********** 2020-07-06T13:15:42.686 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-07-06T13:15:42.688 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:42.730 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.049) 0:00:12.824 *********** 2020-07-06T13:15:42.734 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-07-06T13:15:42.736 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:42.772 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.047) 0:00:12.871 *********** 2020-07-06T13:15:42.787 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-07-06T13:15:42.789 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.824 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.051) 0:00:12.922 *********** 2020-07-06T13:15:42.833 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-06T13:15:42.835 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.876 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.052) 0:00:12.975 *********** 2020-07-06T13:15:42.887 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-07-06T13:15:42.889 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.928 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.051) 0:00:13.027 *********** 2020-07-06T13:15:42.938 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-07-06T13:15:42.939 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:42.980 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:42 +0000 (0:00:00.051) 0:00:13.079 *********** 2020-07-06T13:15:42.993 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.034 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.053) 0:00:13.132 *********** 2020-07-06T13:15:43.045 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-07-06T13:15:43.046 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.087 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.051) 0:00:13.184 *********** 2020-07-06T13:15:43.095 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-06T13:15:43.097 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.142 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.050) 0:00:13.235 *********** 2020-07-06T13:15:43.146 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-06T13:15:43.148 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.187 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.050) 0:00:13.285 *********** 2020-07-06T13:15:43.199 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-06T13:15:43.201 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.238 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.051) 0:00:13.337 *********** 2020-07-06T13:15:43.248 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-07-06T13:15:43.250 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.287 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.048) 0:00:13.385 *********** 2020-07-06T13:15:43.298 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-06T13:15:43.299 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.337 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.050) 0:00:13.436 *********** 2020-07-06T13:15:43.347 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.385 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.048) 0:00:13.484 *********** 2020-07-06T13:15:43.427 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-07-06T13:15:43.429 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:43.472 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.087) 0:00:13.571 *********** 2020-07-06T13:15:43.492 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-06T13:15:43.494 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012673", "end": "2020-07-06 13:15:43.697322", "rc": 0, "start": "2020-07-06 13:15:43.684649", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-06T13:15:43.529 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.056) 0:00:13.628 *********** 2020-07-06T13:15:43.540 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.587 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.057) 0:00:13.685 *********** 2020-07-06T13:15:43.596 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-06T13:15:43.598 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.635 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.048) 0:00:13.733 *********** 2020-07-06T13:15:43.648 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.683 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.047) 0:00:13.781 *********** 2020-07-06T13:15:43.693 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-07-06T13:15:43.694 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.730 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.047) 0:00:13.829 *********** 2020-07-06T13:15:43.739 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.782 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.051) 0:00:13.880 *********** 2020-07-06T13:15:43.791 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-06T13:15:43.793 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.829 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.047) 0:00:13.928 *********** 2020-07-06T13:15:43.839 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-06T13:15:43.840 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.841 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.879 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.050) 0:00:13.978 *********** 2020-07-06T13:15:43.888 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-07-06T13:15:43.890 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.934 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.055) 0:00:14.033 *********** 2020-07-06T13:15:43.944 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-06T13:15:43.946 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:43.983 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:43 +0000 (0:00:00.048) 0:00:14.082 *********** 2020-07-06T13:15:43.993 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.033 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.049) 0:00:14.131 *********** 2020-07-06T13:15:44.041 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-06T13:15:44.043 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.082 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.047) 0:00:14.178 *********** 2020-07-06T13:15:44.089 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.127 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.047) 0:00:14.226 *********** 2020-07-06T13:15:44.158 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-07-06T13:15:44.159 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.194 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.066) 0:00:14.292 *********** 2020-07-06T13:15:44.237 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-06T13:15:44.239 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.011558", "end": "2020-07-06 13:15:44.459554", "rc": 0, "start": "2020-07-06 13:15:44.447996", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-06T13:15:44.281 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.087) 0:00:14.380 *********** 2020-07-06T13:15:44.323 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-06T13:15:44.324 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.372 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.090) 0:00:14.471 *********** 2020-07-06T13:15:44.404 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.447 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.075) 0:00:14.546 *********** 2020-07-06T13:15:44.478 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.517 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.069) 0:00:14.615 *********** 2020-07-06T13:15:44.547 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-07-06T13:15:44.549 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.587 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.069) 0:00:14.685 *********** 2020-07-06T13:15:44.628 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-07-06T13:15:44.630 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.670 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.083) 0:00:14.769 *********** 2020-07-06T13:15:44.701 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-07-06T13:15:44.703 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.739 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.068) 0:00:14.838 *********** 2020-07-06T13:15:44.769 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-07-06T13:15:44.771 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:44.807 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:44 +0000 (0:00:00.068) 0:00:14.906 *********** 2020-07-06T13:15:45.279 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.333154", "end": "2020-07-06 13:15:45.500406", "rc": 0, "start": "2020-07-06 13:15:45.167252", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:15:45.330 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.522) 0:00:15.429 *********** 2020-07-06T13:15:45.341 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.952269", "end": "2020-07-06 13:15:45.500327", "rc": 0, "start": "2020-07-06 13:15:44.548058", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:15:45.381 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.051) 0:00:15.480 *********** 2020-07-06T13:15:45.391 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-07-06T13:15:45.393 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:45.430 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.048) 0:00:15.529 *********** 2020-07-06T13:15:45.441 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:45.495 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.064) 0:00:15.593 *********** 2020-07-06T13:15:45.599 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-07-06T13:15:45.601 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.026393", "end": "2020-07-06 13:15:45.818878", "rc": 0, "start": "2020-07-06 13:15:45.792485", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:15:45.637 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.141) 0:00:15.735 *********** 2020-07-06T13:15:45.667 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.027122", "end": "2020-07-06 13:15:45.870856", "rc": 0, "start": "2020-07-06 13:15:45.843734", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:15:45.704 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:45 +0000 (0:00:00.067) 0:00:15.803 *********** 2020-07-06T13:15:48.907 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi148.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:15:48.945 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:48 +0000 (0:00:03.240) 0:00:19.044 *********** 2020-07-06T13:15:48.965 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:15:49.003 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:49 +0000 (0:00:00.057) 0:00:19.101 *********** 2020-07-06T13:15:49.794 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:15:49.830 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:49 +0000 (0:00:00.827) 0:00:19.929 *********** 2020-07-06T13:15:49.850 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:15:49.892 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:49 +0000 (0:00:00.057) 0:00:19.986 *********** 2020-07-06T13:15:49.898 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-07-06T13:15:49.900 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:49.936 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:49 +0000 (0:00:00.048) 0:00:20.035 *********** 2020-07-06T13:15:49.950 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:49.985 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:49 +0000 (0:00:00.048) 0:00:20.083 *********** 2020-07-06T13:15:50.323 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-07-06T13:15:50.376 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:50 +0000 (0:00:00.391) 0:00:20.474 *********** 2020-07-06T13:15:50.386 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-07-06T13:15:50.429 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:50 +0000 (0:00:00.053) 0:00:20.528 *********** 2020-07-06T13:15:51.191 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-07-06T13:15:51.193 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:15:51.234 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:51 +0000 (0:00:00.804) 0:00:21.333 *********** 2020-07-06T13:15:51.286 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:15:51.338 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:51 +0000 (0:00:00.103) 0:00:21.437 *********** 2020-07-06T13:15:51.589 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-07-06T13:15:51.591 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-07-06T13:15:51.684 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-07-06T13:15:51.905 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-07-06T13:15:52.027 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-07-06T13:15:52.203 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-07-06T13:15:52.243 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:52 +0000 (0:00:00.904) 0:00:22.341 *********** 2020-07-06T13:15:52.329 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-07-06T13:15:52.368 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:52 +0000 (0:00:00.125) 0:00:22.466 *********** 2020-07-06T13:15:52.403 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-07-06T13:15:52.405 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:15:52.444 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:52 +0000 (0:00:00.075) 0:00:22.542 *********** 2020-07-06T13:15:52.508 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:15:52.561 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:52 +0000 (0:00:00.116) 0:00:22.659 *********** 2020-07-06T13:15:52.783 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-06T13:15:52.785 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-07-06T13:15:52.915 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-07-06T13:15:53.076 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-07-06T13:15:53.213 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-07-06T13:15:53.401 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-07-06T13:15:53.445 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.884) 0:00:23.544 *********** 2020-07-06T13:15:53.489 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-06T13:15:53.491 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-07-06T13:15:53.531 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.085) 0:00:23.629 *********** 2020-07-06T13:15:53.547 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-06T13:15:53.549 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-07-06T13:15:53.591 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.059) 0:00:23.689 *********** 2020-07-06T13:15:53.610 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-06T13:15:53.612 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.652 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.060) 0:00:23.750 *********** 2020-07-06T13:15:53.661 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-06T13:15:53.662 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-07-06T13:15:53.704 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.048) 0:00:23.799 *********** 2020-07-06T13:15:53.710 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-06T13:15:53.712 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:53.751 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.050) 0:00:23.849 *********** 2020-07-06T13:15:53.760 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-06T13:15:53.762 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.806 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.054) 0:00:23.904 *********** 2020-07-06T13:15:53.816 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-06T13:15:53.818 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.858 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.052) 0:00:23.956 *********** 2020-07-06T13:15:53.866 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-06T13:15:53.868 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:53.905 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.047) 0:00:24.004 *********** 2020-07-06T13:15:53.915 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-06T13:15:53.917 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.955 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:53 +0000 (0:00:00.049) 0:00:24.054 *********** 2020-07-06T13:15:53.964 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-06T13:15:53.966 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.976 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:53.978 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-06T13:15:54.015 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:54 +0000 (0:00:00.059) 0:00:24.113 *********** 2020-07-06T13:15:54.056 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-06T13:15:54.058 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:54.097 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:54 +0000 (0:00:00.081) 0:00:24.195 *********** 2020-07-06T13:15:54.841 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:15:54.886 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:54 +0000 (0:00:00.789) 0:00:24.984 *********** 2020-07-06T13:15:55.002 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:15:55.045 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:55 +0000 (0:00:00.158) 0:00:25.143 *********** 2020-07-06T13:15:55.224 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-07-06T13:15:55.226 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-07-06T13:15:55.276 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:55 +0000 (0:00:00.230) 0:00:25.374 *********** 2020-07-06T13:15:55.401 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-07-06T13:15:55.439 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:55 +0000 (0:00:00.163) 0:00:25.538 *********** 2020-07-06T13:15:55.630 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-06T13:15:55.632 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-07-06T13:15:55.687 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:55 +0000 (0:00:00.247) 0:00:25.785 *********** 2020-07-06T13:15:55.782 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-07-06T13:15:55.824 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:55 +0000 (0:00:00.136) 0:00:25.921 *********** 2020-07-06T13:15:55.864 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-06T13:15:55.866 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-07-06T13:15:55.960 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-07-06T13:15:56.002 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.179) 0:00:26.101 *********** 2020-07-06T13:15:56.023 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-07-06T13:15:56.045 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-06T13:15:56.047 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:56.083 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.081) 0:00:26.182 *********** 2020-07-06T13:15:56.095 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-06T13:15:56.097 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-07-06T13:15:56.138 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.054) 0:00:26.236 *********** 2020-07-06T13:15:56.148 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-07-06T13:15:56.150 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:56.187 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.049) 0:00:26.286 *********** 2020-07-06T13:15:56.196 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-06T13:15:56.198 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:56.234 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.046) 0:00:26.332 *********** 2020-07-06T13:15:56.244 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-06T13:15:56.246 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:56.282 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.047) 0:00:26.380 *********** 2020-07-06T13:15:56.291 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-07-06T13:15:56.293 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-06T13:15:56.329 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.047) 0:00:26.428 *********** 2020-07-06T13:15:56.358 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:56.395 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.065) 0:00:26.493 *********** 2020-07-06T13:15:56.679 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-06T13:15:56.681 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-07-06T13:15:56.719 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.324) 0:00:26.818 *********** 2020-07-06T13:15:56.746 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-07-06T13:15:56.786 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:56 +0000 (0:00:00.066) 0:00:26.884 *********** 2020-07-06T13:15:57.417 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-07-06T13:15:57.418 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ActiveEnterTimestampMonotonic": "17827000", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target -.mount system.slice systemd-tmpfiles-setup.service network.target sysinit.target systemd-journald.socket local-fs.target nss-lookup.target time-sync.target basic.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:24 UTC", "AssertTimestampMonotonic": "17825345", "Before": "plymouth-quit.service xdm.service shutdown.target getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ConditionTimestampMonotonic": "17825345", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-07-06T13:15:57.420 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1092", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ExecMainStartTimestampMonotonic": "17826957", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:24 UTC", "InactiveExitTimestampMonotonic": "17827000", "InvocationID": "eca7048b32834245961b0055f5b25c11", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-07-06T13:15:57.422 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1092", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-07-06T13:15:57.423 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:24 UTC", "StateChangeTimestampMonotonic": "17827000", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:24 UTC", "WatchdogTimestampMonotonic": "17826999", "WatchdogUSec": "0"}} ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ActiveEnterTimestampMonotonic": "18129521", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service basic.target system.slice remote-fs.target var-run.mount network.target local-fs.target time-sync.target -.mount nss-lookup. 2020-07-06T13:15:57.425 INFO:teuthology.task.ansible.out:target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:38 UTC", "AssertTimestampMonotonic": "18128311", "Before": "xdm.service multi-user.target shutdown.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ConditionTimestampMonotonic": "18128311", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1142", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ExecMainStartTimestampMonotonic": 2020-07-06T13:15:57.427 INFO:teuthology.task.ansible.out:"18129491", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:38 UTC", "InactiveExitTimestampMonotonic": "18129521", "InvocationID": "412c91b66cb64105a3a2ff8f038e3cc6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "102 2020-07-06T13:15:57.428 INFO:teuthology.task.ansible.out:4", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1142", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "Star 2020-07-06T13:15:57.430 INFO:teuthology.task.ansible.out:tLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:38 UTC", "StateChangeTimestampMonotonic": "18129521", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:38 UTC", "WatchdogTimestampMonotonic": "18129520", "WatchdogUSec": "0"}} 2020-07-06T13:15:57.462 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.676) 0:00:27.560 *********** 2020-07-06T13:15:57.500 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.038) 0:00:27.598 *********** 2020-07-06T13:15:57.508 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-07-06T13:15:57.510 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.550 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.050) 0:00:27.649 *********** 2020-07-06T13:15:57.560 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.597 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.046) 0:00:27.696 *********** 2020-07-06T13:15:57.610 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.645 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.047) 0:00:27.743 *********** 2020-07-06T13:15:57.654 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.692 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.046) 0:00:27.790 *********** 2020-07-06T13:15:57.700 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-07-06T13:15:57.701 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.738 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.046) 0:00:27.836 *********** 2020-07-06T13:15:57.748 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.785 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.047) 0:00:27.884 *********** 2020-07-06T13:15:57.794 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-07-06T13:15:57.795 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.831 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.046) 0:00:27.930 *********** 2020-07-06T13:15:57.840 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.877 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.045) 0:00:27.976 *********** 2020-07-06T13:15:57.887 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-07-06T13:15:57.889 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.924 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.046) 0:00:28.022 *********** 2020-07-06T13:15:57.933 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:57.974 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:57 +0000 (0:00:00.050) 0:00:28.073 *********** 2020-07-06T13:15:57.984 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-06T13:15:57.985 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.022 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.047) 0:00:28.120 *********** 2020-07-06T13:15:58.032 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.069 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.046) 0:00:28.167 *********** 2020-07-06T13:15:58.081 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.119 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.049) 0:00:28.217 *********** 2020-07-06T13:15:58.133 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.175 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.055) 0:00:28.273 *********** 2020-07-06T13:15:58.184 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-07-06T13:15:58.186 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.223 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.048) 0:00:28.322 *********** 2020-07-06T13:15:58.232 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.270 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.046) 0:00:28.368 *********** 2020-07-06T13:15:58.278 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-06T13:15:58.294 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.316 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.046) 0:00:28.414 *********** 2020-07-06T13:15:58.325 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.363 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.047) 0:00:28.462 *********** 2020-07-06T13:15:58.373 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-06T13:15:58.375 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.410 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.046) 0:00:28.508 *********** 2020-07-06T13:15:58.419 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:58.460 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.050) 0:00:28.558 *********** 2020-07-06T13:15:58.468 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-06T13:15:58.470 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-07-06T13:15:58.506 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.046) 0:00:28.605 *********** 2020-07-06T13:15:58.516 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-07-06T13:15:58.556 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.049) 0:00:28.654 *********** 2020-07-06T13:15:58.563 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-06T13:15:58.565 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-07-06T13:15:58.604 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.048) 0:00:28.703 *********** 2020-07-06T13:15:58.614 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-07-06T13:15:58.657 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.052) 0:00:28.756 *********** 2020-07-06T13:15:58.665 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-06T13:15:58.667 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-07-06T13:15:58.710 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.052) 0:00:28.808 *********** 2020-07-06T13:15:58.719 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-07-06T13:15:58.758 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.047) 0:00:28.856 *********** 2020-07-06T13:15:58.767 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-07-06T13:15:58.769 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-06T13:15:58.806 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.048) 0:00:28.905 *********** 2020-07-06T13:15:58.815 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-06T13:15:58.854 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.047) 0:00:28.953 *********** 2020-07-06T13:15:58.947 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-06T13:15:58.949 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-07-06T13:15:58.985 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:58 +0000 (0:00:00.130) 0:00:29.083 *********** 2020-07-06T13:15:59.016 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-07-06T13:15:59.053 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.068) 0:00:29.152 *********** 2020-07-06T13:15:59.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-07-06T13:15:59.126 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "name": "ubuntu", "state": "present", "system": false} 2020-07-06T13:15:59.167 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.113) 0:00:29.265 *********** 2020-07-06T13:15:59.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-07-06T13:15:59.199 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "name": "ubuntu", "state": "present", "system": false} 2020-07-06T13:15:59.236 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.068) 0:00:29.334 *********** 2020-07-06T13:15:59.275 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.038) 0:00:29.373 *********** 2020-07-06T13:15:59.282 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-06T13:15:59.284 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:59.321 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.046) 0:00:29.419 *********** 2020-07-06T13:15:59.330 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:59.369 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.047) 0:00:29.467 *********** 2020-07-06T13:15:59.399 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-06T13:15:59.401 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:15:59.437 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.068) 0:00:29.535 *********** 2020-07-06T13:15:59.485 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-06T13:15:59.487 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-07-06T13:15:59.526 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.088) 0:00:29.624 *********** 2020-07-06T13:15:59.599 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-07-06T13:15:59.642 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.116) 0:00:29.740 *********** 2020-07-06T13:15:59.914 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-06T13:15:59.916 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-07-06T13:15:59.957 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:15:59 +0000 (0:00:00.314) 0:00:30.055 *********** 2020-07-06T13:15:59.998 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-07-06T13:16:00.000 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi118"}, "changed": false} 2020-07-06T13:16:00.036 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:00 +0000 (0:00:00.079) 0:00:30.135 *********** 2020-07-06T13:16:00.048 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-06T13:16:00.050 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-07-06T13:16:00.089 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:00 +0000 (0:00:00.052) 0:00:30.187 *********** 2020-07-06T13:16:00.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-07-06T13:16:00.133 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi148"}, "changed": false} 2020-07-06T13:16:00.168 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:00 +0000 (0:00:00.079) 0:00:30.267 *********** 2020-07-06T13:16:00.921 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-07-06T13:16:00.922 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi118", "ansible_hostname": "smithi118", "ansible_nodename": "smithi118"}, "changed": false, "name": "smithi118"} 2020-07-06T13:16:00.963 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:00 +0000 (0:00:00.794) 0:00:31.061 *********** 2020-07-06T13:16:01.056 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi148", "ansible_hostname": "smithi148", "ansible_nodename": "smithi148"}, "changed": false, "name": "smithi148"} 2020-07-06T13:16:01.098 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:01 +0000 (0:00:00.135) 0:00:31.196 *********** 2020-07-06T13:16:01.297 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-07-06T13:16:01.299 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-07-06T13:16:01.340 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:01 +0000 (0:00:00.242) 0:00:31.439 *********** 2020-07-06T13:16:01.459 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-07-06T13:16:01.497 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:01 +0000 (0:00:00.156) 0:00:31.595 *********** 2020-07-06T13:16:01.695 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-07-06T13:16:01.697 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-07-06T13:16:01.734 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:01 +0000 (0:00:00.236) 0:00:31.833 *********** 2020-07-06T13:16:01.861 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-07-06T13:16:01.905 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:01 +0000 (0:00:00.170) 0:00:32.003 *********** 2020-07-06T13:16:02.238 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-07-06T13:16:02.240 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-06T13:16:02.278 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.373) 0:00:32.377 *********** 2020-07-06T13:16:02.311 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-07-06T13:16:02.313 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.350 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.071) 0:00:32.449 *********** 2020-07-06T13:16:02.378 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi148.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-06T13:16:02.419 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.068) 0:00:32.517 *********** 2020-07-06T13:16:02.428 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-06T13:16:02.430 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.471 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.051) 0:00:32.569 *********** 2020-07-06T13:16:02.479 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-07-06T13:16:02.481 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.525 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.054) 0:00:32.624 *********** 2020-07-06T13:16:02.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-06T13:16:02.537 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.574 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.048) 0:00:32.673 *********** 2020-07-06T13:16:02.584 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-06T13:16:02.586 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.623 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.048) 0:00:32.721 *********** 2020-07-06T13:16:02.646 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-06T13:16:02.648 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.682 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.058) 0:00:32.780 *********** 2020-07-06T13:16:02.692 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-06T13:16:02.693 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.731 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.048) 0:00:32.829 *********** 2020-07-06T13:16:02.740 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-06T13:16:02.742 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.778 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.047) 0:00:32.877 *********** 2020-07-06T13:16:02.788 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-06T13:16:02.790 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.827 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.049) 0:00:32.926 *********** 2020-07-06T13:16:02.837 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-06T13:16:02.839 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.876 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.048) 0:00:32.974 *********** 2020-07-06T13:16:02.886 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-06T13:16:02.888 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.925 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.049) 0:00:33.024 *********** 2020-07-06T13:16:02.935 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-06T13:16:02.937 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:02.973 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:02 +0000 (0:00:00.047) 0:00:33.072 *********** 2020-07-06T13:16:02.986 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.022 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:33.120 *********** 2020-07-06T13:16:03.032 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-06T13:16:03.033 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.073 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.051) 0:00:33.172 *********** 2020-07-06T13:16:03.084 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-06T13:16:03.085 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.123 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.049) 0:00:33.221 *********** 2020-07-06T13:16:03.133 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-06T13:16:03.172 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.049) 0:00:33.271 *********** 2020-07-06T13:16:03.183 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-06T13:16:03.184 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.221 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:33.320 *********** 2020-07-06T13:16:03.231 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-06T13:16:03.269 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.047) 0:00:33.367 *********** 2020-07-06T13:16:03.281 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-06T13:16:03.317 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:33.415 *********** 2020-07-06T13:16:03.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-06T13:16:03.371 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.054) 0:00:33.470 *********** 2020-07-06T13:16:03.381 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-06T13:16:03.534 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.162) 0:00:33.632 *********** 2020-07-06T13:16:03.544 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-06T13:16:03.546 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.583 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:33.681 *********** 2020-07-06T13:16:03.592 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-06T13:16:03.632 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.049) 0:00:33.731 *********** 2020-07-06T13:16:03.642 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-06T13:16:03.644 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.687 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.054) 0:00:33.785 *********** 2020-07-06T13:16:03.696 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-06T13:16:03.698 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.735 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:33.834 *********** 2020-07-06T13:16:03.747 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-06T13:16:03.748 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.785 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.049) 0:00:33.884 *********** 2020-07-06T13:16:03.796 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-06T13:16:03.798 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.837 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.051) 0:00:33.935 *********** 2020-07-06T13:16:03.848 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:03.850 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.886 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.049) 0:00:33.984 *********** 2020-07-06T13:16:03.897 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-06T13:16:03.899 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.937 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.051) 0:00:34.036 *********** 2020-07-06T13:16:03.947 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-06T13:16:03.949 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:03.986 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:03 +0000 (0:00:00.048) 0:00:34.084 *********** 2020-07-06T13:16:03.996 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:03.998 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.035 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.133 *********** 2020-07-06T13:16:04.044 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-06T13:16:04.046 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.084 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.049) 0:00:34.182 *********** 2020-07-06T13:16:04.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-06T13:16:04.096 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.133 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.231 *********** 2020-07-06T13:16:04.143 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-06T13:16:04.145 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.184 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.051) 0:00:34.283 *********** 2020-07-06T13:16:04.193 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-06T13:16:04.195 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.231 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.046) 0:00:34.329 *********** 2020-07-06T13:16:04.242 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-06T13:16:04.243 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.283 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.052) 0:00:34.382 *********** 2020-07-06T13:16:04.296 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.333 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.049) 0:00:34.431 *********** 2020-07-06T13:16:04.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-06T13:16:04.344 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.381 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.479 *********** 2020-07-06T13:16:04.391 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-06T13:16:04.392 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.430 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.528 *********** 2020-07-06T13:16:04.439 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-06T13:16:04.441 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.477 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.047) 0:00:34.576 *********** 2020-07-06T13:16:04.490 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.526 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.625 *********** 2020-07-06T13:16:04.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-06T13:16:04.538 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.574 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.047) 0:00:34.673 *********** 2020-07-06T13:16:04.585 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-06T13:16:04.587 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.623 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.049) 0:00:34.722 *********** 2020-07-06T13:16:04.633 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-06T13:16:04.635 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.672 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.771 *********** 2020-07-06T13:16:04.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-06T13:16:04.689 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.726 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.054) 0:00:34.825 *********** 2020-07-06T13:16:04.737 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-06T13:16:04.739 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.776 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.049) 0:00:34.874 *********** 2020-07-06T13:16:04.786 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-06T13:16:04.792 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.825 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.048) 0:00:34.923 *********** 2020-07-06T13:16:04.835 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:04.836 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.876 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.051) 0:00:34.975 *********** 2020-07-06T13:16:04.893 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-06T13:16:04.895 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.932 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.054) 0:00:35.030 *********** 2020-07-06T13:16:04.943 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-07-06T13:16:04.950 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:04.982 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:04 +0000 (0:00:00.050) 0:00:35.081 *********** 2020-07-06T13:16:04.993 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:04.995 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.034 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.051) 0:00:35.133 *********** 2020-07-06T13:16:05.133 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 06 July 2020 13:16:05 +0000 (0:00:00.050) 0:00:35.184 *********** TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.142 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.056) 0:00:35.240 *********** 2020-07-06T13:16:05.152 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-07-06T13:16:05.154 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.195 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.052) 0:00:35.293 *********** 2020-07-06T13:16:05.204 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-07-06T13:16:05.206 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.244 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.049) 0:00:35.343 *********** 2020-07-06T13:16:05.254 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-06T13:16:05.256 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.294 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.049) 0:00:35.392 *********** 2020-07-06T13:16:05.305 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-07-06T13:16:05.307 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.342 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.048) 0:00:35.441 *********** 2020-07-06T13:16:05.352 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-06T13:16:05.354 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.390 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.047) 0:00:35.488 *********** 2020-07-06T13:16:05.400 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-06T13:16:05.402 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.438 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.047) 0:00:35.536 *********** 2020-07-06T13:16:05.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.488 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.047) 0:00:35.584 *********** 2020-07-06T13:16:05.496 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-06T13:16:05.498 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.534 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.047) 0:00:35.632 *********** 2020-07-06T13:16:05.543 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-07-06T13:16:05.545 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.585 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.051) 0:00:35.683 *********** 2020-07-06T13:16:05.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-06T13:16:05.597 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.634 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.047) 0:00:35.731 *********** 2020-07-06T13:16:05.643 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-07-06T13:16:05.645 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.681 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.048) 0:00:35.780 *********** 2020-07-06T13:16:05.690 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-07-06T13:16:05.692 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.731 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.049) 0:00:35.830 *********** 2020-07-06T13:16:05.770 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-07-06T13:16:05.772 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:05.807 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.076) 0:00:35.906 *********** 2020-07-06T13:16:05.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-06T13:16:05.829 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004991", "end": "2020-07-06 13:16:06.052213", "rc": 0, "start": "2020-07-06 13:16:06.047222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:05.865 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.057) 0:00:35.963 *********** 2020-07-06T13:16:05.896 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-06T13:16:05.932 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.067) 0:00:36.031 *********** 2020-07-06T13:16:05.963 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-06T13:16:05.964 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005094", "end": "2020-07-06 13:16:06.168672", "rc": 0, "start": "2020-07-06 13:16:06.163578", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:06.001 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:05 +0000 (0:00:00.068) 0:00:36.100 *********** 2020-07-06T13:16:06.030 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-06T13:16:06.067 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:06 +0000 (0:00:00.066) 0:00:36.166 *********** 2020-07-06T13:16:06.265 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-07-06T13:16:06.304 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:06 +0000 (0:00:00.236) 0:00:36.403 *********** 2020-07-06T13:16:06.339 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-06T13:16:06.342 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:06.378 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:06 +0000 (0:00:00.072) 0:00:36.476 *********** 2020-07-06T13:16:06.421 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-07-06T13:16:06.462 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:06 +0000 (0:00:00.084) 0:00:36.560 *********** 2020-07-06T13:16:06.505 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-06T13:16:06.506 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:06.552 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:06 +0000 (0:00:00.090) 0:00:36.650 *********** 2020-07-06T13:16:07.666 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-06T13:16:07.668 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-07-06T13:16:07.759 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-07-06T13:16:08.585 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-07-06T13:16:08.621 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:08 +0000 (0:00:02.069) 0:00:38.720 *********** 2020-07-06T13:16:08.715 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-07-06T13:16:08.753 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:08 +0000 (0:00:00.131) 0:00:38.852 *********** 2020-07-06T13:16:09.501 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:16:09.539 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.786) 0:00:39.638 *********** 2020-07-06T13:16:09.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-06T13:16:09.610 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.070) 0:00:39.708 *********** 2020-07-06T13:16:09.654 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:16:09.707 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.094) 0:00:39.802 *********** 2020-07-06T13:16:09.734 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-06T13:16:09.772 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.068) 0:00:39.871 *********** 2020-07-06T13:16:09.798 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-06T13:16:09.800 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036127", "end": "2020-07-06 13:16:10.011925", "rc": 0, "start": "2020-07-06 13:16:09.975798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:09.838 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.064) 0:00:39.935 *********** 2020-07-06T13:16:09.952 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035928", "end": "2020-07-06 13:16:10.159406", "rc": 0, "start": "2020-07-06 13:16:10.123478", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:09.995 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:09 +0000 (0:00:00.157) 0:00:40.093 *********** 2020-07-06T13:16:12.716 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:16:12.762 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:12 +0000 (0:00:02.766) 0:00:42.860 *********** 2020-07-06T13:16:12.815 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:16:12.854 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:12 +0000 (0:00:00.092) 0:00:42.953 *********** 2020-07-06T13:16:22.014 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-07-06T13:16:22.016 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102030 files and directories 2020-07-06T13:16:22.018 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading 2020-07-06T13:16:22.019 INFO:teuthology.task.ansible.out:database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102030 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-07-06T13:16:22.053 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:22 +0000 (0:00:09.198) 0:00:52.151 *********** 2020-07-06T13:16:22.263 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102030 files and directories 2020-07-06T13:16:22.265 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading 2020-07-06T13:16:22.267 INFO:teuthology.task.ansible.out:database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102030 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-07-06T13:16:22.301 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:22 +0000 (0:00:00.248) 0:00:52.400 *********** 2020-07-06T13:16:22.949 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:22.951 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:16:22.987 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:22 +0000 (0:00:00.685) 0:00:53.085 *********** 2020-07-06T13:16:23.017 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:23.053 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:23 +0000 (0:00:00.066) 0:00:53.151 *********** 2020-07-06T13:16:23.186 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:23.188 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:16:23.226 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:23 +0000 (0:00:00.173) 0:00:53.325 *********** 2020-07-06T13:16:23.257 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-06T13:16:23.258 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:23.293 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:23 +0000 (0:00:00.066) 0:00:53.391 *********** 2020-07-06T13:16:31.565 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-06T13:16:31.567 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.2 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.2 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.28 [39.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.28 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.28 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.28 [870 kB]\nFetched 10.4 MB in 1s (9666 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-07-06T13:16:31.569 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101888 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.2_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.2_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-07-06T13:16:31.571 INFO:teuthology.task.ansible.out:1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.2 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.2 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.28 [39.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.28 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.28 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.28 [870 kB]", "Fetched 10.4 MB in 1s (9666 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Readi 2020-07-06T13:16:31.572 INFO:teuthology.task.ansible.out:ng database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101888 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.2_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.2_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-07-06T13:16:31.603 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:31 +0000 (0:00:08.310) 0:01:01.702 *********** 2020-07-06T13:16:31.950 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.2 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.2 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.28 [39.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.28 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.28 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.28 [870 kB]\nFetched 10.4 MB in 1s (9296 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-07-06T13:16:31.952 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101888 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.2_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.2_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.2) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-07-06T13:16:31.954 INFO:teuthology.task.ansible.out:1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.2 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.2 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.28 [39.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.28 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.28 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.28 [870 kB]", "Fetched 10.4 MB in 1s (9296 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Readi 2020-07-06T13:16:31.955 INFO:teuthology.task.ansible.out:ng database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101888 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.2_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.2_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.28_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.2) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.2) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.28) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.28) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-07-06T13:16:31.990 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:31 +0000 (0:00:00.386) 0:01:02.088 *********** 2020-07-06T13:16:32.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-06T13:16:32.469 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:16:32.506 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:32 +0000 (0:00:00.516) 0:01:02.604 *********** 2020-07-06T13:16:32.640 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-06T13:16:32.642 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-07-06T13:16:32.677 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:32 +0000 (0:00:00.170) 0:01:02.775 *********** 2020-07-06T13:16:32.706 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-06T13:16:32.707 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:32.742 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:32 +0000 (0:00:00.065) 0:01:02.841 *********** 2020-07-06T13:16:32.880 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:16:32.917 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:32 +0000 (0:00:00.174) 0:01:03.015 *********** 2020-07-06T13:16:32.927 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-07-06T13:16:32.929 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-07-06T13:16:32.966 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:32 +0000 (0:00:00.048) 0:01:03.064 *********** 2020-07-06T13:16:33.052 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-06T13:16:33.054 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-07-06T13:16:33.093 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.127) 0:01:03.192 *********** 2020-07-06T13:16:33.134 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-06T13:16:33.136 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:33.174 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.080) 0:01:03.272 *********** 2020-07-06T13:16:33.309 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-07-06T13:16:33.311 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-07-06T13:16:33.345 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.171) 0:01:03.444 *********** 2020-07-06T13:16:33.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-07-06T13:16:33.359 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-07-06T13:16:33.396 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.050) 0:01:03.495 *********** 2020-07-06T13:16:33.572 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi148.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1222, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-06T13:16:33.607 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.211) 0:01:03.706 *********** 2020-07-06T13:16:33.711 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-07-06T13:16:33.713 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-07-06T13:16:33.749 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.141) 0:01:03.847 *********** 2020-07-06T13:16:33.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:33.796 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.046) 0:01:03.894 *********** 2020-07-06T13:16:33.909 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-06T13:16:33.911 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1222, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-06T13:16:33.946 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:33 +0000 (0:00:00.150) 0:01:04.045 *********** 2020-07-06T13:16:34.080 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-07-06T13:16:34.082 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:34.123 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.176) 0:01:04.222 *********** 2020-07-06T13:16:34.132 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-06T13:16:34.134 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:39 UTC", "ActiveEnterTimestampMonotonic": "18551751", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket network.target nss-lookup.target systemd-tmpfiles-setup.service remote-fs.target -.mount sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:38 UTC", "AssertTimestampMonotonic": "18126175", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ConditionTimestampMonotonic": "18126175", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-07-06T13:16:34.135 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1232", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:39 UTC", "ExecMainStartTimestampMonotonic": "18551739", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:38 UTC", "InactiveExitTimestampMonotonic": "18126817", "InvocationID": "eee1c78b83aa4ee88317962bff6fe23b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-07-06T13:16:34.137 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1232", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-07-06T13:16:34.139 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:39 UTC", "StateChangeTimestampMonotonic": "18551751", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:39 UTC", "WatchdogTimestampMonotonic": "18551750", "WatchdogUSec": "0"}} 2020-07-06T13:16:34.172 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.048) 0:01:04.271 *********** 2020-07-06T13:16:34.203 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-06T13:16:34.204 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.247 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.074) 0:01:04.345 *********** 2020-07-06T13:16:34.249 INFO:teuthology.task.ansible.out: 2020-07-06T13:16:34.278 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-06T13:16:34.279 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.314 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.066) 0:01:04.412 *********** 2020-07-06T13:16:34.343 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-06T13:16:34.345 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.379 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.065) 0:01:04.478 *********** 2020-07-06T13:16:34.409 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-06T13:16:34.411 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.452 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.066) 0:01:04.544 *********** 2020-07-06T13:16:34.456 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-06T13:16:34.457 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ActiveEnterTimestampMonotonic": "18255376", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target nss-lookup.target systemd-tmpfiles-setup.service -.mount network.target basic.target systemd-journald.socket sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:24 UTC", "AssertTimestampMonotonic": "17823921", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ConditionTimestampMonotonic": "17823921", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-07-06T13:16:34.460 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1169", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ExecMainStartTimestampMonotonic": "18255349", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:24 UTC", "InactiveExitTimestampMonotonic": "17825299", "InvocationID": "c71077bf51de4fadaab553b8bfd655cf", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-07-06T13:16:34.462 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1169", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-07-06T13:16:34.463 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:24 UTC", "StateChangeTimestampMonotonic": "18255376", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:24 UTC", "WatchdogTimestampMonotonic": "18255374", "WatchdogUSec": "0"}} 2020-07-06T13:16:34.495 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.049) 0:01:04.594 *********** 2020-07-06T13:16:34.507 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-06T13:16:34.509 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.544 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.048) 0:01:04.642 *********** 2020-07-06T13:16:34.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-06T13:16:34.556 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.592 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.048) 0:01:04.690 *********** 2020-07-06T13:16:34.602 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-06T13:16:34.604 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.639 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.047) 0:01:04.738 *********** 2020-07-06T13:16:34.649 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-06T13:16:34.650 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.686 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.046) 0:01:04.785 *********** 2020-07-06T13:16:34.696 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-06T13:16:34.698 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.734 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.047) 0:01:04.832 *********** 2020-07-06T13:16:34.744 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-06T13:16:34.746 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.782 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.047) 0:01:04.880 *********** 2020-07-06T13:16:34.792 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-06T13:16:34.793 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.829 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.047) 0:01:04.927 *********** 2020-07-06T13:16:34.839 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-06T13:16:34.841 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.875 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.046) 0:01:04.974 *********** 2020-07-06T13:16:34.885 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:34.887 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.923 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.047) 0:01:05.021 *********** 2020-07-06T13:16:34.932 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-06T13:16:34.934 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:34.973 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:34 +0000 (0:00:00.049) 0:01:05.071 *********** 2020-07-06T13:16:34.982 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-06T13:16:34.984 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.020 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.046) 0:01:05.118 *********** 2020-07-06T13:16:35.029 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-06T13:16:35.031 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.067 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.165 *********** 2020-07-06T13:16:35.077 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-06T13:16:35.078 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.114 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.213 *********** 2020-07-06T13:16:35.127 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-06T13:16:35.128 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.164 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.049) 0:01:05.263 *********** 2020-07-06T13:16:35.174 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:35.176 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.212 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.311 *********** 2020-07-06T13:16:35.222 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-06T13:16:35.224 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.260 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:05.359 *********** 2020-07-06T13:16:35.270 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-06T13:16:35.272 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.308 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:05.407 *********** 2020-07-06T13:16:35.319 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:35.321 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.356 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.455 *********** 2020-07-06T13:16:35.367 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:35.368 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.405 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:05.503 *********** 2020-07-06T13:16:35.415 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-06T13:16:35.416 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.454 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.049) 0:01:05.553 *********** 2020-07-06T13:16:35.464 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:35.466 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.502 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.600 *********** 2020-07-06T13:16:35.511 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-06T13:16:35.513 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.549 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.647 *********** 2020-07-06T13:16:35.559 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:35.561 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.602 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.053) 0:01:05.701 *********** 2020-07-06T13:16:35.612 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-06T13:16:35.613 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.649 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.748 *********** 2020-07-06T13:16:35.665 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-06T13:16:35.667 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.701 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.051) 0:01:05.800 *********** 2020-07-06T13:16:35.711 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-06T13:16:35.713 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.750 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:05.848 *********** 2020-07-06T13:16:35.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-06T13:16:35.760 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.797 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.895 *********** 2020-07-06T13:16:35.806 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:35.808 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.845 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:05.944 *********** 2020-07-06T13:16:35.855 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-06T13:16:35.857 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.893 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:05.991 *********** 2020-07-06T13:16:35.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:35.904 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.941 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.048) 0:01:06.039 *********** 2020-07-06T13:16:35.950 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:35.952 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:35.988 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:35 +0000 (0:00:00.047) 0:01:06.086 *********** 2020-07-06T13:16:36.001 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:36.002 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.039 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.050) 0:01:06.137 *********** 2020-07-06T13:16:36.048 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:36.049 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.086 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.046) 0:01:06.184 *********** 2020-07-06T13:16:36.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-06T13:16:36.096 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.134 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.047) 0:01:06.232 *********** 2020-07-06T13:16:36.143 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:36.145 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.181 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.046) 0:01:06.279 *********** 2020-07-06T13:16:36.190 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-06T13:16:36.191 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.229 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.048) 0:01:06.327 *********** 2020-07-06T13:16:36.238 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:36.240 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.276 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.047) 0:01:06.375 *********** 2020-07-06T13:16:36.285 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-06T13:16:36.287 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.324 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.047) 0:01:06.423 *********** 2020-07-06T13:16:36.342 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:36.344 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.377 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.052) 0:01:06.476 *********** 2020-07-06T13:16:36.385 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:36.389 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.424 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.047) 0:01:06.523 *********** 2020-07-06T13:16:36.433 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:36.435 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.471 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.046) 0:01:06.569 *********** 2020-07-06T13:16:36.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:36.480 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.524 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.044) 0:01:06.614 *********** TASK [testnode : Set grub config.] ********************************************* 2020-07-06T13:16:36.528 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.562 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.046) 0:01:06.661 *********** 2020-07-06T13:16:36.570 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:36.572 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.608 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.045) 0:01:06.706 *********** 2020-07-06T13:16:36.638 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-06T13:16:36.640 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.675 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.066) 0:01:06.773 *********** 2020-07-06T13:16:36.695 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-07-06T13:16:36.697 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-07-06T13:16:36.734 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.058) 0:01:06.832 *********** 2020-07-06T13:16:36.744 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-06T13:16:36.746 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.784 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.050) 0:01:06.883 *********** 2020-07-06T13:16:36.814 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-06T13:16:36.816 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.853 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.068) 0:01:06.951 *********** 2020-07-06T13:16:36.882 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-07-06T13:16:36.884 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:36.920 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:36 +0000 (0:00:00.067) 0:01:07.019 *********** 2020-07-06T13:16:37.054 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-07-06T13:16:37.056 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-07-06T13:16:37.091 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.170) 0:01:07.189 *********** 2020-07-06T13:16:37.101 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-06T13:16:37.103 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-07-06T13:16:37.139 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.048) 0:01:07.238 *********** 2020-07-06T13:16:37.178 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-06T13:16:37.180 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:37.220 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.080) 0:01:07.318 *********** 2020-07-06T13:16:37.425 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-06T13:16:37.427 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-07-06T13:16:37.466 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.245) 0:01:07.564 *********** 2020-07-06T13:16:37.498 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:37.536 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.067) 0:01:07.632 *********** 2020-07-06T13:16:37.575 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-07-06T13:16:37.577 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-07-06T13:16:37.612 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.078) 0:01:07.710 *********** 2020-07-06T13:16:37.881 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-07-06T13:16:37.921 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:37 +0000 (0:00:00.308) 0:01:08.019 *********** 2020-07-06T13:16:37.972 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-06T13:16:37.974 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-07-06T13:16:38.011 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.089) 0:01:08.109 *********** 2020-07-06T13:16:38.260 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-07-06T13:16:38.298 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.287) 0:01:08.397 *********** 2020-07-06T13:16:38.351 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-07-06T13:16:38.353 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-07-06T13:16:38.396 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.091) 0:01:08.489 *********** 2020-07-06T13:16:38.528 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-06T13:16:38.530 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:38.566 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.175) 0:01:08.664 *********** 2020-07-06T13:16:38.594 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-06T13:16:38.596 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:38.632 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.066) 0:01:08.731 *********** 2020-07-06T13:16:38.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-07-06T13:16:38.663 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-07-06T13:16:38.703 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.070) 0:01:08.801 *********** 2020-07-06T13:16:38.713 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-06T13:16:38.714 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:38.751 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.048) 0:01:08.850 *********** 2020-07-06T13:16:38.782 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-06T13:16:38.784 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:38.819 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.067) 0:01:08.918 *********** 2020-07-06T13:16:38.839 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-06T13:16:38.841 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:38.878 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.058) 0:01:08.977 *********** 2020-07-06T13:16:38.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-06T13:16:38.889 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:38.926 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.047) 0:01:09.024 *********** 2020-07-06T13:16:38.935 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-06T13:16:38.937 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:38.973 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:38 +0000 (0:00:00.046) 0:01:09.071 *********** 2020-07-06T13:16:38.985 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-07-06T13:16:38.987 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.023 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.049) 0:01:09.121 *********** 2020-07-06T13:16:39.033 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-06T13:16:39.034 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.072 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.049) 0:01:09.171 *********** 2020-07-06T13:16:39.080 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:39.082 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-06T13:16:39.119 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.046) 0:01:09.217 *********** 2020-07-06T13:16:39.129 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-06T13:16:39.130 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.178 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.056) 0:01:09.274 *********** 2020-07-06T13:16:39.186 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-06T13:16:39.188 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.199 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.201 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.236 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.060) 0:01:09.335 *********** 2020-07-06T13:16:39.247 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-06T13:16:39.249 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi148.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.249 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.251 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.252 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.263 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.264 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-07-06T13:16:39.265 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.301 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.064) 0:01:09.399 *********** 2020-07-06T13:16:39.343 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.042) 0:01:09.442 *********** 2020-07-06T13:16:39.351 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:39.353 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-06T13:16:39.398 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.054) 0:01:09.496 *********** 2020-07-06T13:16:39.448 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-06T13:16:39.449 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.460 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.470 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.481 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.482 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.492 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-06T13:16:39.503 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.513 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.515 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.525 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.526 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.536 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.547 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.548 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.592 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.194) 0:01:09.690 *********** 2020-07-06T13:16:39.601 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-06T13:16:39.602 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004838", "end": "2020-07-06 13:16:39.540061", "rc": 0, "start": "2020-07-06 13:16:39.535223", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-06T13:16:39.644 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.052) 0:01:09.743 *********** 2020-07-06T13:16:39.686 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-06T13:16:39.687 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.727 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.082) 0:01:09.825 *********** 2020-07-06T13:16:39.767 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-07-06T13:16:39.769 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.807 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.079) 0:01:09.905 *********** 2020-07-06T13:16:39.817 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-06T13:16:39.819 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004084", "end": "2020-07-06 13:16:39.774768", "rc": 0, "start": "2020-07-06 13:16:39.770684", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-06T13:16:39.860 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.053) 0:01:09.958 *********** 2020-07-06T13:16:39.870 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-07-06T13:16:39.871 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.907 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.047) 0:01:10.006 *********** 2020-07-06T13:16:39.917 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-06T13:16:39.919 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:39.959 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:39 +0000 (0:00:00.051) 0:01:10.057 *********** 2020-07-06T13:16:39.987 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-07-06T13:16:39.989 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:40.027 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:40 +0000 (0:00:00.068) 0:01:10.125 *********** 2020-07-06T13:16:40.068 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-07-06T13:16:40.070 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:40.108 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:40 +0000 (0:00:00.080) 0:01:10.206 *********** 2020-07-06T13:16:40.805 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-06T13:16:40.807 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:16:40.842 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:40 +0000 (0:00:00.734) 0:01:10.940 *********** 2020-07-06T13:16:40.873 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-06T13:16:40.875 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:40.909 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:40 +0000 (0:00:00.066) 0:01:11.007 *********** 2020-07-06T13:16:40.960 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-06T13:16:40.961 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item={'block_used': 13633284, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461824, 'size_available': 927587631104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461824, "block_size": 4096, "block_total": 240095108, "block_used": 13633284, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587631104, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}} 2020-07-06T13:16:40.997 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:40 +0000 (0:00:00.087) 0:01:11.095 *********** 2020-07-06T13:16:41.017 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-06T13:16:41.019 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:16:41.057 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.060) 0:01:11.156 *********** 2020-07-06T13:16:41.088 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-06T13:16:41.089 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:41.124 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.067) 0:01:11.223 *********** 2020-07-06T13:16:41.143 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-06T13:16:41.144 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010098", "end": "2020-07-06 13:16:41.351877", "rc": 0, "start": "2020-07-06 13:16:41.341779", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:41.181 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.056) 0:01:11.279 *********** 2020-07-06T13:16:41.188 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-06T13:16:41.189 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item={'block_used': 13633294, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461814, 'size_available': 927587590144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461814, "block_size": 4096, "block_total": 240095108, "block_used": 13633294, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587590144, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}} 2020-07-06T13:16:41.228 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.047) 0:01:11.326 *********** 2020-07-06T13:16:41.238 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-06T13:16:41.239 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'block_used': 13633284, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461824, 'size_available': 927587631104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461824, "block_size": 4096, "block_total": 240095108, "block_used": 13633284, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587631104, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:41.277 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.048) 0:01:11.375 *********** 2020-07-06T13:16:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-06T13:16:41.342 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.065) 0:01:11.440 *********** 2020-07-06T13:16:41.371 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-06T13:16:41.373 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009749", "end": "2020-07-06 13:16:41.596557", "rc": 0, "start": "2020-07-06 13:16:41.586808", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:41.408 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.066) 0:01:11.507 *********** 2020-07-06T13:16:41.419 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-06T13:16:41.420 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:41.452 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-06T13:16:41.454 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'block_used': 13633294, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461814, 'size_available': 927587590144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461814, "block_size": 4096, "block_total": 240095108, "block_used": 13633294, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587590144, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:41.489 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.081) 0:01:11.588 *********** 2020-07-06T13:16:41.528 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-06T13:16:41.563 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:41 +0000 (0:00:00.073) 0:01:11.662 *********** 2020-07-06T13:16:41.616 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-06T13:16:41.617 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:43.330 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok6Hbgiy1ocAJtEwngIKvajIGe8nNdAU3X'], 'uuids': ['a7ba1123-00b5-4f33-acae-76c39cc66aaf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.800730", "end": "2020-07-06 13:16:43.526339", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok6Hbgiy1ocAJtEwngIKvajIGe8nNdAU3X"], "labels": [], "masters": [], "uuids": ["a7ba1123-00b5-4f33-acae-76c39cc66aaf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:41.725609", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:43.341 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:43.342 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:43.627 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47HVCGieuu2jj9vCHUndi8pA4HyiSLoydi'], 'uuids': ['160b7018-454e-4d4e-b70b-306c61a8b22f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.888241", "end": "2020-07-06 13:16:43.845908", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47HVCGieuu2jj9vCHUndi8pA4HyiSLoydi"], "labels": [], "masters": [], "uuids": ["160b7018-454e-4d4e-b70b-306c61a8b22f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:41.957667", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:43.629 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:43.640 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:44.604 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokckWMCtGKWkC6bDiSCxSum4q0ADZU4f3J'], 'uuids': ['91288f54-1655-4326-8656-a88992304f19']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.132775", "end": "2020-07-06 13:16:44.807063", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokckWMCtGKWkC6bDiSCxSum4q0ADZU4f3J"], "labels": [], "masters": [], "uuids": ["91288f54-1655-4326-8656-a88992304f19"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:43.674288", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:44.616 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFK4', 'wwn-0x5000c50092924465'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFK4-part1', 'wwn-0x5000c50092924465-part1'], 'uuids': ['bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092924465', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFK4', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFK4", "wwn-0x5000c50092924465"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFK4-part1", "wwn-0x5000c50092924465-part1"], "labels": [], "masters": [], "uuids": ["bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFK4", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924465"}}, "skip_reason": 2020-07-06T13:16:44.618 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-07-06T13:16:44.897 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vQr9GKDyaJ89E6VawO7GB4CG3UljHlbu'], 'uuids': ['5bbb5291-543c-4590-bff8-90d3dd3aac4e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.135300", "end": "2020-07-06 13:16:45.119684", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vQr9GKDyaJ89E6VawO7GB4CG3UljHlbu"], "labels": [], "masters": [], "uuids": ["5bbb5291-543c-4590-bff8-90d3dd3aac4e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:43.984384", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:44.908 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QARN', 'wwn-0x5000c50091e0b046'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QARN-part1', 'wwn-0x5000c50091e0b046-part1'], 'uuids': ['bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0b046', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QARN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QARN", "wwn-0x5000c50091e0b046"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QARN-part1", "wwn-0x5000c50091e0b046-part1"], "labels": [], "masters": [], "uuids": ["bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QARN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b046"}}, "skip_reason": 2020-07-06T13:16:44.910 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-07-06T13:16:46.082 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-uAyyDy-bJHq-IB49-Ze9j-UeH4-hLst-2GpAN4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233005G400BGN', 'nvme-nvme.8086-43564654363233333030354734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.344850", "end": "2020-07-06 13:16:46.289137", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-uAyyDy-bJHq-IB49-Ze9j-UeH4-hLst-2GpAN4", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005G400BGN", "nvme-nvme.8086-43564654363233333030354734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:44.944287", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-06T13:16:46.084 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:46.094 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:46.105 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:46.178 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-7I62gL-u3mv-ux5f-U5ZN-QuDQ-j8bS-dOesNk', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204011J400BGN', 'nvme-nvme.8086-50484654363230343031314a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.149206", "end": "2020-07-06 13:16:46.404419", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7I62gL-u3mv-ux5f-U5ZN-QuDQ-j8bS-dOesNk", "nvme-INTEL_SSDPEDMD400G4_PHFT6204011J400BGN", "nvme-nvme.8086-50484654363230343031314a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:45.255213", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-06T13:16:46.180 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:46.190 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:46.201 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:47.366 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokRfGmdoSCBqotR3fNOQPaZXFxE6zU4ug8'], 'uuids': ['17e8999a-21df-41ed-b61c-77320f55ea35']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.138255", "end": "2020-07-06 13:16:47.565450", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokRfGmdoSCBqotR3fNOQPaZXFxE6zU4ug8"], "labels": [], "masters": [], "uuids": ["17e8999a-21df-41ed-b61c-77320f55ea35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:46.427195", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:47.378 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:47.379 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:47.452 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj4744ddkeDFgTpYZbvbdGNc046c156c3fSR'], 'uuids': ['d4e98551-91ab-4885-b1ea-e2eb982f2367']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.128905", "end": "2020-07-06 13:16:47.669288", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj4744ddkeDFgTpYZbvbdGNc046c156c3fSR"], "labels": [], "masters": [], "uuids": ["d4e98551-91ab-4885-b1ea-e2eb982f2367"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:46.540383", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:47.467 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:47.468 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:48.711 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vxQaXdTMubeepI97QHp7taj5wCAyOhVf'], 'uuids': ['afe69715-2212-4720-8032-bbfa910fdc41']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.116153", "end": "2020-07-06 13:16:48.928815", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vxQaXdTMubeepI97QHp7taj5wCAyOhVf"], "labels": [], "masters": [], "uuids": ["afe69715-2212-4720-8032-bbfa910fdc41"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:47.812662", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:48.723 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:48.828 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok2LRFonkkOMQgJEfPyXwULVSnGChcN3gj'], 'uuids': ['d0c962a1-e71e-44f4-b66f-e1a41fb19078']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.321983", "end": "2020-07-06 13:16:49.033189", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok2LRFonkkOMQgJEfPyXwULVSnGChcN3gj"], "labels": [], "masters": [], "uuids": ["d0c962a1-e71e-44f4-b66f-e1a41fb19078"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:47.711206", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:48.840 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:49.983 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47zh6DUglY90zIe2JigVdSIWF7UuQpVYEB'], 'uuids': ['c524e37e-c668-4a13-88f7-5949c11485ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.123581", "end": "2020-07-06 13:16:50.195812", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47zh6DUglY90zIe2JigVdSIWF7UuQpVYEB"], "labels": [], "masters": [], "uuids": ["c524e37e-c668-4a13-88f7-5949c11485ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:49.072231", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:50.031 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:50 +0000 (0:00:08.467) 0:01:20.129 *********** 2020-07-06T13:16:50.083 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-06T13:16:50.085 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.095 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-06T13:16:50.097 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokalNK1sScOolRe8Cdy48RCBJKD9S01Lah'], 'uuids': ['fc7d33d1-4cd5-42d9-905d-4da6707f15fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.131718", "end": "2020-07-06 13:16:50.291980", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokalNK1sScOolRe8Cdy48RCBJKD9S01Lah"], "labels": [], "masters": [], "uuids": ["fc7d33d1-4cd5-42d9-905d-4da6707f15fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:49.160262", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-06T13:16:50.154 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:50 +0000 (0:00:00.123) 0:01:20.252 *********** 2020-07-06T13:16:50.206 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-06T13:16:50.208 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.357 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47HVCGieuu2jj9vCHUndi8pA4HyiSLoydi'], 'uuids': ['160b7018-454e-4d4e-b70b-306c61a8b22f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.151610", "end": "2020-07-06 13:16:50.582782", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47HVCGieuu2jj9vCHUndi8pA4HyiSLoydi"], "labels": [], "masters": [], "uuids": ["160b7018-454e-4d4e-b70b-306c61a8b22f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:50.431172", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142561 s, 809 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142561 s, 809 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:50.369 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.380 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.560 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok6Hbgiy1ocAJtEwngIKvajIGe8nNdAU3X'], 'uuids': ['a7ba1123-00b5-4f33-acae-76c39cc66aaf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.220808", "end": "2020-07-06 13:16:50.760484", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok6Hbgiy1ocAJtEwngIKvajIGe8nNdAU3X"], "labels": [], "masters": [], "uuids": ["a7ba1123-00b5-4f33-acae-76c39cc66aaf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:50.539676", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142147 s, 811 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142147 s, 811 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:50.561 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.573 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:50.646 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vQr9GKDyaJ89E6VawO7GB4CG3UljHlbu'], 'uuids': ['5bbb5291-543c-4590-bff8-90d3dd3aac4e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.150989", "end": "2020-07-06 13:16:50.866329", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vQr9GKDyaJ89E6VawO7GB4CG3UljHlbu"], "labels": [], "masters": [], "uuids": ["5bbb5291-543c-4590-bff8-90d3dd3aac4e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:50.715340", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146526 s, 787 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146526 s, 787 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:50.658 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QARN', 'wwn-0x5000c50091e0b046'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QARN-part1', 'wwn-0x5000c50091e0b046-part1'], 'uuids': ['bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0b046', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QARN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QARN", "wwn-0x5000c50091e0b046"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QARN-part1", "wwn-0x5000c50091e0b046-part1"], "labels": [], "masters": [], "uuids": ["bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QARN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b046"}}, "skip_reason": 2020-07-06T13:16:50.660 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-07-06T13:16:50.841 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokckWMCtGKWkC6bDiSCxSum4q0ADZU4f3J'], 'uuids': ['91288f54-1655-4326-8656-a88992304f19']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.151904", "end": "2020-07-06 13:16:51.045284", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokckWMCtGKWkC6bDiSCxSum4q0ADZU4f3J"], "labels": [], "masters": [], "uuids": ["91288f54-1655-4326-8656-a88992304f19"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:50.893380", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148004 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148004 s, 779 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:50.853 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFK4', 'wwn-0x5000c50092924465'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFK4-part1', 'wwn-0x5000c50092924465-part1'], 'uuids': ['bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092924465', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFK4', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFK4", "wwn-0x5000c50092924465"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFK4-part1", "wwn-0x5000c50092924465-part1"], "labels": [], "masters": [], "uuids": ["bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFK4", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924465"}}, "skip_reason": 2020-07-06T13:16:50.855 INFO:teuthology.task.ansible.out:"Conditional result was False"} changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-7I62gL-u3mv-ux5f-U5ZN-QuDQ-j8bS-dOesNk', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204011J400BGN', 'nvme-nvme.8086-50484654363230343031314a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.045929", "end": "2020-07-06 13:16:51.066645", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7I62gL-u3mv-ux5f-U5ZN-QuDQ-j8bS-dOesNk", "nvme-INTEL_SSDPEDMD400G4_PHFT6204011J400BGN", "nvme-nvme.8086-50484654363230343031314a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.020716", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) cop 2020-07-06T13:16:50.857 INFO:teuthology.task.ansible.out:ied, 0.0430623 s, 2.7 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0430623 s, 2.7 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:50.869 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.024 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-uAyyDy-bJHq-IB49-Ze9j-UeH4-hLst-2GpAN4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233005G400BGN', 'nvme-nvme.8086-43564654363233333030354734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051710", "end": "2020-07-06 13:16:51.230621", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-uAyyDy-bJHq-IB49-Ze9j-UeH4-hLst-2GpAN4", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005G400BGN", "nvme-nvme.8086-43564654363233333030354734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.178911", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.046978 s, 2.5 GB/s", "stde 2020-07-06T13:16:51.026 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.046978 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.046 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.058 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.142 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj4744ddkeDFgTpYZbvbdGNc046c156c3fSR'], 'uuids': ['d4e98551-91ab-4885-b1ea-e2eb982f2367']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.150392", "end": "2020-07-06 13:16:51.362356", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj4744ddkeDFgTpYZbvbdGNc046c156c3fSR"], "labels": [], "masters": [], "uuids": ["d4e98551-91ab-4885-b1ea-e2eb982f2367"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.211964", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147626 s, 781 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147626 s, 781 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.154 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.165 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.322 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokRfGmdoSCBqotR3fNOQPaZXFxE6zU4ug8'], 'uuids': ['17e8999a-21df-41ed-b61c-77320f55ea35']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146254", "end": "2020-07-06 13:16:51.525249", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokRfGmdoSCBqotR3fNOQPaZXFxE6zU4ug8"], "labels": [], "masters": [], "uuids": ["17e8999a-21df-41ed-b61c-77320f55ea35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.378995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143368 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143368 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.333 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.344 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.440 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vxQaXdTMubeepI97QHp7taj5wCAyOhVf'], 'uuids': ['afe69715-2212-4720-8032-bbfa910fdc41']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.158596", "end": "2020-07-06 13:16:51.662371", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47vxQaXdTMubeepI97QHp7taj5wCAyOhVf"], "labels": [], "masters": [], "uuids": ["afe69715-2212-4720-8032-bbfa910fdc41"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.503775", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153834 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153834 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.452 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.623 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok2LRFonkkOMQgJEfPyXwULVSnGChcN3gj'], 'uuids': ['d0c962a1-e71e-44f4-b66f-e1a41fb19078']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.158680", "end": "2020-07-06 13:16:51.827433", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBok2LRFonkkOMQgJEfPyXwULVSnGChcN3gj"], "labels": [], "masters": [], "uuids": ["d0c962a1-e71e-44f4-b66f-e1a41fb19078"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.668753", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154108 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154108 s, 748 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.636 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:51.731 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47zh6DUglY90zIe2JigVdSIWF7UuQpVYEB'], 'uuids': ['c524e37e-c668-4a13-88f7-5949c11485ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.163491", "end": "2020-07-06 13:16:51.950349", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-bDEdWSoW11qeejSnSrNcpmTD6hDgNj47zh6DUglY90zIe2JigVdSIWF7UuQpVYEB"], "labels": [], "masters": [], "uuids": ["c524e37e-c668-4a13-88f7-5949c11485ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.786858", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158766 s, 727 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158766 s, 727 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.778 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:51 +0000 (0:00:01.624) 0:01:21.877 *********** 2020-07-06T13:16:51.942 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokalNK1sScOolRe8Cdy48RCBJKD9S01Lah'], 'uuids': ['fc7d33d1-4cd5-42d9-905d-4da6707f15fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.168816", "end": "2020-07-06 13:16:52.133350", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zOcCmAbp31qia66hc31lyTbLrQl4bBokalNK1sScOolRe8Cdy48RCBJKD9S01Lah"], "labels": [], "masters": [], "uuids": ["fc7d33d1-4cd5-42d9-905d-4da6707f15fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-06 13:16:51.964534", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164069 s, 703 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164069 s, 703 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:51.990 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:51 +0000 (0:00:00.211) 0:01:22.089 *********** 2020-07-06T13:16:52.054 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-07-06T13:16:52.055 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.123275", "end": "2020-07-06 13:16:52.268405", "rc": 0, "start": "2020-07-06 13:16:52.145130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:52.095 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.104) 0:01:22.193 *********** 2020-07-06T13:16:52.263 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.124886", "end": "2020-07-06 13:16:52.464960", "rc": 0, "start": "2020-07-06 13:16:52.340074", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:52.304 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.209) 0:01:22.402 *********** 2020-07-06T13:16:52.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-06T13:16:52.316 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052447", "end": "2020-07-06 13:16:52.515437", "rc": 0, "start": "2020-07-06 13:16:52.462990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:52.361 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.057) 0:01:22.460 *********** 2020-07-06T13:16:52.394 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-06T13:16:52.437 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.074) 0:01:22.535 *********** 2020-07-06T13:16:52.469 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-06T13:16:52.471 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.515 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.078) 0:01:22.613 *********** 2020-07-06T13:16:52.527 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-06T13:16:52.528 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048893", "end": "2020-07-06 13:16:52.700949", "rc": 0, "start": "2020-07-06 13:16:52.652056", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:16:52.566 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.051) 0:01:22.665 *********** 2020-07-06T13:16:52.577 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-07-06T13:16:52.579 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.615 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.048) 0:01:22.713 *********** 2020-07-06T13:16:52.624 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-06T13:16:52.664 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.049) 0:01:22.763 *********** 2020-07-06T13:16:52.673 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-06T13:16:52.675 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.715 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.050) 0:01:22.813 *********** 2020-07-06T13:16:52.723 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-06T13:16:52.725 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.766 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.051) 0:01:22.865 *********** 2020-07-06T13:16:52.776 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-06T13:16:52.777 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.816 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.049) 0:01:22.914 *********** 2020-07-06T13:16:52.826 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-07-06T13:16:52.828 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.867 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.051) 0:01:22.965 *********** 2020-07-06T13:16:52.906 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:52.948 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:52 +0000 (0:00:00.081) 0:01:23.047 *********** 2020-07-06T13:16:52.957 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-07-06T13:16:52.960 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:53.003 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.054) 0:01:23.101 *********** 2020-07-06T13:16:53.012 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-06T13:16:53.014 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.052 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.049) 0:01:23.150 *********** 2020-07-06T13:16:53.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-06T13:16:53.062 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'block_used': 13633294, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461814, 'size_available': 927587590144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461814, "block_size": 4096, "block_total": 240095108, "block_used": 13633294, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587590144, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.101 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.048) 0:01:23.199 *********** 2020-07-06T13:16:53.142 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-06T13:16:53.144 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.178 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.077) 0:01:23.277 *********** 2020-07-06T13:16:53.188 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-06T13:16:53.226 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.047) 0:01:23.325 *********** 2020-07-06T13:16:53.236 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:53.238 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.276 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.049) 0:01:23.374 *********** 2020-07-06T13:16:53.284 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-06T13:16:53.286 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'block_used': 13633284, 'uuid': 'bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226461824, 'size_available': 927587631104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113812, 'block_size': 4096, 'inode_available': 60941164}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226461824, "block_size": 4096, "block_total": 240095108, "block_used": 13633284, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941164, "inode_total": 61054976, "inode_used": 113812, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927587631104, "size_total": 983429562368, "uuid": "bb4a3e31-b0e2-40a1-a1cc-d4fabb14c57b"}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.323 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.046) 0:01:23.421 *********** 2020-07-06T13:16:53.331 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:53.333 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.370 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.046) 0:01:23.468 *********** 2020-07-06T13:16:53.378 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-06T13:16:53.379 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.415 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.045) 0:01:23.514 *********** 2020-07-06T13:16:53.423 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-06T13:16:53.425 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.462 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.046) 0:01:23.560 *********** 2020-07-06T13:16:53.471 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:53.473 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.509 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.046) 0:01:23.607 *********** 2020-07-06T13:16:53.518 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-06T13:16:53.520 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.557 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.048) 0:01:23.655 *********** 2020-07-06T13:16:53.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:16:53.568 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.613 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.056) 0:01:23.711 *********** 2020-07-06T13:16:53.624 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-06T13:16:53.626 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.675 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.061) 0:01:23.773 *********** 2020-07-06T13:16:53.686 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-06T13:16:53.688 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.728 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.053) 0:01:23.827 *********** 2020-07-06T13:16:53.759 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-06T13:16:53.762 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.798 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.069) 0:01:23.897 *********** 2020-07-06T13:16:53.829 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-06T13:16:53.831 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:53.866 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:53 +0000 (0:00:00.068) 0:01:23.965 *********** 2020-07-06T13:16:54.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-07-06T13:16:54.312 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-06T13:16:54.349 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:54 +0000 (0:00:00.482) 0:01:24.448 *********** 2020-07-06T13:16:54.361 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-06T13:16:54.401 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:54 +0000 (0:00:00.051) 0:01:24.499 *********** 2020-07-06T13:16:54.952 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-06T13:16:54.954 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.212 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.214 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.452 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.455 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.706 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.758 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:55.970 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:56.012 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:01.610) 0:01:26.110 *********** 2020-07-06T13:16:56.021 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-06T13:16:56.062 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.050) 0:01:26.160 *********** 2020-07-06T13:16:56.154 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-06T13:16:56.156 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-06T13:16:56.194 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.132) 0:01:26.293 *********** 2020-07-06T13:16:56.215 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-06T13:16:56.252 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.057) 0:01:26.351 *********** 2020-07-06T13:16:56.348 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-06T13:16:56.350 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.415 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.469 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.533 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.596 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.652 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.715 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.726 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:56.766 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.513) 0:01:26.865 *********** 2020-07-06T13:16:56.787 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-06T13:16:56.800 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-06T13:16:56.842 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.076) 0:01:26.941 *********** 2020-07-06T13:16:56.916 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-06T13:16:56.918 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:16:56.956 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:56 +0000 (0:00:00.113) 0:01:27.054 *********** 2020-07-06T13:16:56.999 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:16:57.000 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-06T13:16:57.053 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:57 +0000 (0:00:00.097) 0:01:27.152 *********** 2020-07-06T13:16:57.102 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:57 +0000 (0:00:00.048) 0:01:27.200 *********** 2020-07-06T13:16:57.111 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-06T13:16:57.150 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:57 +0000 (0:00:00.048) 0:01:27.248 *********** 2020-07-06T13:16:57.618 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-07-06T13:16:57.620 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true} 2020-07-06T13:16:57.659 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:57 +0000 (0:00:00.509) 0:01:27.757 *********** 2020-07-06T13:16:58.130 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-06T13:16:58.132 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-06T13:16:58.166 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.506) 0:01:28.264 *********** 2020-07-06T13:16:58.310 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-06T13:16:58.312 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-07-06T13:16:58.347 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.181) 0:01:28.446 *********** 2020-07-06T13:16:58.491 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-06T13:16:58.493 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:16:58.530 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.182) 0:01:28.628 *********** 2020-07-06T13:16:58.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-07-06T13:16:58.614 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true} 2020-07-06T13:16:58.651 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.121) 0:01:28.749 *********** 2020-07-06T13:16:58.887 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-06T13:16:58.889 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1222, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-07-06T13:16:58.937 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.286) 0:01:29.036 *********** 2020-07-06T13:16:58.948 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-06T13:16:58.954 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-06T13:16:58.989 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:58 +0000 (0:00:00.051) 0:01:29.087 *********** 2020-07-06T13:16:59.151 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-06T13:16:59.153 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-07-06T13:16:59.198 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:59 +0000 (0:00:00.209) 0:01:29.297 *********** 2020-07-06T13:16:59.316 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-07-06T13:16:59.317 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-07-06T13:16:59.355 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:59 +0000 (0:00:00.157) 0:01:29.454 *********** 2020-07-06T13:16:59.366 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-07-06T13:16:59.408 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:59 +0000 (0:00:00.052) 0:01:29.506 *********** 2020-07-06T13:16:59.755 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-06T13:16:59.761 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1222, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-07-06T13:16:59.809 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:16:59 +0000 (0:00:00.401) 0:01:29.908 *********** 2020-07-06T13:17:00.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-07-06T13:17:00.166 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-07-06T13:17:00.201 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:00 +0000 (0:00:00.391) 0:01:30.299 *********** 2020-07-06T13:17:00.256 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-06T13:17:00.258 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:17:00.304 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:00 +0000 (0:00:00.102) 0:01:30.402 *********** 2020-07-06T13:17:00.492 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-06T13:17:00.495 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048049", "end": "2020-07-06 13:17:00.720109", "rc": 0, "start": "2020-07-06 13:17:00.672060", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-07-06T13:17:00.530 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:00 +0000 (0:00:00.225) 0:01:30.628 *********** 2020-07-06T13:17:00.571 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-06T13:17:00.573 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:00.630 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:00 +0000 (0:00:00.099) 0:01:30.728 *********** 2020-07-06T13:17:00.661 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-06T13:17:00.663 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:00.703 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:00 +0000 (0:00:00.073) 0:01:30.801 *********** 2020-07-06T13:17:01.105 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-06T13:17:01.107 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:17:01.147 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.444) 0:01:31.245 *********** 2020-07-06T13:17:01.344 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-06T13:17:01.345 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048449", "end": "2020-07-06 13:17:01.549899", "rc": 0, "start": "2020-07-06 13:17:01.501450", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-07-06T13:17:01.382 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.235) 0:01:31.481 *********** 2020-07-06T13:17:01.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-06T13:17:01.429 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:01.466 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.083) 0:01:31.564 *********** 2020-07-06T13:17:01.498 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-06T13:17:01.499 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:01.536 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.070) 0:01:31.635 *********** 2020-07-06T13:17:01.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-06T13:17:01.548 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:17:01.587 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.050) 0:01:31.686 *********** 2020-07-06T13:17:01.617 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-06T13:17:01.618 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:01.659 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:01 +0000 (0:00:00.071) 0:01:31.758 *********** 2020-07-06T13:17:01.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-06T13:17:01.996 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-07-06T13:17:02.033 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.373) 0:01:32.131 *********** 2020-07-06T13:17:02.063 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-06T13:17:02.064 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:02.101 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.067) 0:01:32.199 *********** 2020-07-06T13:17:02.331 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-06T13:17:02.334 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ActiveEnterTimestampMonotonic": "17588453", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target systemd-tmpfiles-setup.service system.slice -.mount sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:24 UTC", "AssertTimestampMonotonic": "17512068", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ConditionTimestampMonotonic": "17512068", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-07-06T13:17:02.335 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "973", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:24 UTC", "ExecMainStartTimestampMonotonic": "17588432", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:24 UTC", "InactiveExitTimestampMonotonic": "17513154", "InvocationID": "14be3bba11cf4009bcc724c1cf114cb9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2020-07-06T13:17:02.337 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "973", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:24 UTC", "Sta 2020-07-06T13:17:02.339 INFO:teuthology.task.ansible.out:teChangeTimestampMonotonic": "17588453", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:24 UTC", "WatchdogTimestampMonotonic": "17588452", "WatchdogUSec": "0"}} 2020-07-06T13:17:02.377 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.276) 0:01:32.475 *********** 2020-07-06T13:17:02.408 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:17:02.409 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-06T13:17:02.449 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.071) 0:01:32.547 *********** 2020-07-06T13:17:02.460 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-06T13:17:02.461 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:17:02.500 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.051) 0:01:32.599 *********** 2020-07-06T13:17:02.511 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:17:02.514 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:02.553 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.052) 0:01:32.651 *********** 2020-07-06T13:17:02.563 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-06T13:17:02.565 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:02.608 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.054) 0:01:32.706 *********** 2020-07-06T13:17:02.617 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-06T13:17:02.618 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:02.660 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:02 +0000 (0:00:00.052) 0:01:32.759 *********** 2020-07-06T13:17:02.986 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-06T13:17:02.988 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-07-06T13:17:03.029 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.368) 0:01:33.127 *********** 2020-07-06T13:17:03.070 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-06T13:17:03.071 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:03.121 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.092) 0:01:33.220 *********** 2020-07-06T13:17:03.352 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-06T13:17:03.358 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ActiveEnterTimestampMonotonic": "17892541", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount basic.target system.slice network.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-07-06 13:14:38 UTC", "AssertTimestampMonotonic": "17672037", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ConditionTimestampMonotonic": "17672037", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-07-06T13:17:03.360 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "967", "ExecMainStartTimestamp": "Mon 2020-07-06 13:14:38 UTC", "ExecMainStartTimestampMonotonic": "17892532", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-07-06 13:14:38 UTC", "InactiveExitTimestampMonotonic": "17672737", "InvocationID": "9e2a58bb9672487c89ddc86d8648dd27", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2020-07-06T13:17:03.361 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "967", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-07-06 13:14:38 UTC", "Sta 2020-07-06T13:17:03.363 INFO:teuthology.task.ansible.out:teChangeTimestampMonotonic": "17892541", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-07-06 13:14:38 UTC", "WatchdogTimestampMonotonic": "17892540", "WatchdogUSec": "0"}} 2020-07-06T13:17:03.397 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.275) 0:01:33.495 *********** 2020-07-06T13:17:03.428 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:17:03.429 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-06T13:17:03.468 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.071) 0:01:33.566 *********** 2020-07-06T13:17:03.499 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-06T13:17:03.500 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"cache_update_time": 1594041318, "cache_updated": false, "changed": false} 2020-07-06T13:17:03.502 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:03.540 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.072) 0:01:33.639 *********** 2020-07-06T13:17:03.584 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.041) 0:01:33.681 *********** 2020-07-06T13:17:03.593 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-06T13:17:03.594 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:03.633 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.050) 0:01:33.731 *********** 2020-07-06T13:17:03.643 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-06T13:17:03.645 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:03.682 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.048) 0:01:33.780 *********** 2020-07-06T13:17:03.774 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-06T13:17:03.776 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-07-06T13:17:03.814 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:03 +0000 (0:00:00.132) 0:01:33.913 *********** 2020-07-06T13:17:04.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-06T13:17:04.181 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1222, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-07-06T13:17:04.222 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:04 +0000 (0:00:00.407) 0:01:34.321 *********** 2020-07-06T13:17:04.575 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-06T13:17:04.577 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"cache_update_time": 1594041322, "cache_updated": false, "changed": false} 2020-07-06T13:17:04.613 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:04 +0000 (0:00:00.390) 0:01:34.711 *********** 2020-07-06T13:17:04.643 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-06T13:17:04.645 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:04.680 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:04 +0000 (0:00:00.067) 0:01:34.778 *********** 2020-07-06T13:17:04.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-06T13:17:04.815 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "gid": 1222, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-07-06T13:17:04.851 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:04 +0000 (0:00:00.170) 0:01:34.949 *********** 2020-07-06T13:17:05.295 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-06T13:17:05.297 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1222, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install packages via pip] ************************************* ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-06T13:17:05.337 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:05 +0000 (0:00:00.486) 0:01:35.436 *********** 2020-07-06T13:17:05.378 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:05 +0000 (0:00:00.040) 0:01:35.476 *********** 2020-07-06T13:17:05.828 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-06T13:17:05.830 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false} 2020-07-06T13:17:05.868 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:05 +0000 (0:00:00.489) 0:01:35.966 *********** 2020-07-06T13:17:05.899 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-06T13:17:05.901 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-06T13:17:05.937 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:05 +0000 (0:00:00.069) 0:01:36.035 *********** 2020-07-06T13:17:06.083 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-06T13:17:06.084 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1594041285.4636934, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1594041285.4556932, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 6308, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1594041285.4556932, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1154892698", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-07-06T13:17:06.127 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.189) 0:01:36.225 *********** 2020-07-06T13:17:06.137 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-07-06T13:17:06.138 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-06T13:17:06.180 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.052) 0:01:36.278 *********** 2020-07-06T13:17:06.546 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-06T13:17:06.547 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-07-06T13:17:06.587 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.407) 0:01:36.686 *********** 2020-07-06T13:17:06.631 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-06T13:17:06.633 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-06T13:17:06.670 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.082) 0:01:36.768 *********** 2020-07-06T13:17:06.691 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-06T13:17:06.692 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false} 2020-07-06T13:17:06.731 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.060) 0:01:36.829 *********** 2020-07-06T13:17:06.740 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-07-06T13:17:06.742 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:06.781 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.050) 0:01:36.879 *********** 2020-07-06T13:17:06.791 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-06T13:17:06.793 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-06T13:17:06.831 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.049) 0:01:36.929 *********** 2020-07-06T13:17:06.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-06T13:17:06.914 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-06T13:17:06.949 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:06 +0000 (0:00:00.118) 0:01:37.048 *********** 2020-07-06T13:17:06.982 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-06T13:17:06.984 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1594041299.6664975, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1594041299.6624975, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 6308, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1594041299.6624975, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1154892698", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-07-06T13:17:07.020 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.070) 0:01:37.118 *********** 2020-07-06T13:17:07.091 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-07-06T13:17:07.093 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-06T13:17:07.129 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.109) 0:01:37.228 *********** 2020-07-06T13:17:07.160 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-06T13:17:07.162 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi148.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-07-06T13:17:07.197 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.067) 0:01:37.296 *********** 2020-07-06T13:17:07.234 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.036) 0:01:37.332 *********** 2020-07-06T13:17:07.254 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-06T13:17:07.257 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.266 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.267 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-06T13:17:07.268 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-06T13:17:07.307 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.073) 0:01:37.406 *********** 2020-07-06T13:17:07.346 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.038) 0:01:37.444 *********** 2020-07-06T13:17:07.361 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-06T13:17:07.363 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.370 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi118.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.375 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.376 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.414 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.068) 0:01:37.513 *********** 2020-07-06T13:17:07.457 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.042) 0:01:37.556 *********** 2020-07-06T13:17:07.469 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:17:07.471 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.510 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.052) 0:01:37.608 *********** 2020-07-06T13:17:07.542 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-06T13:17:07.544 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.594 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.083) 0:01:37.692 *********** 2020-07-06T13:17:07.602 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-06T13:17:07.604 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-06T13:17:07.646 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.052) 0:01:37.744 *********** 2020-07-06T13:17:07.655 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-06T13:17:07.657 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.696 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.050) 0:01:37.794 *********** 2020-07-06T13:17:07.727 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-06T13:17:07.729 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.765 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.068) 0:01:37.863 *********** 2020-07-06T13:17:07.795 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.798 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi148.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-06T13:17:07.834 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.069) 0:01:37.933 *********** 2020-07-06T13:17:07.874 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.040) 0:01:37.973 *********** 2020-07-06T13:17:07.884 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-06T13:17:07.886 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.924 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.049) 0:01:38.023 *********** 2020-07-06T13:17:07.934 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-06T13:17:07.935 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:07.977 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:07 +0000 (0:00:00.052) 0:01:38.076 *********** 2020-07-06T13:17:07.987 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-06T13:17:07.989 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.031 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.054) 0:01:38.130 *********** 2020-07-06T13:17:08.042 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-06T13:17:08.043 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.045 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.045 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.083 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.051) 0:01:38.182 *********** 2020-07-06T13:17:08.094 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-06T13:17:08.096 INFO:teuthology.task.ansible.out:skipping: [smithi118.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.134 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.050) 0:01:38.233 *********** 2020-07-06T13:17:08.144 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-06T13:17:08.146 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.156 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.158 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi148.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.199 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.064) 0:01:38.297 *********** 2020-07-06T13:17:08.230 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-06T13:17:08.232 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.269 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.070) 0:01:38.368 *********** 2020-07-06T13:17:08.300 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-06T13:17:08.302 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi118.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011307", "end": "2020-07-06 13:17:08.516307", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-06 13:17:08.505000", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:08.338 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.068) 0:01:38.436 *********** 2020-07-06T13:17:08.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-06T13:17:08.370 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.407 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.069) 0:01:38.505 *********** 2020-07-06T13:17:08.427 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-06T13:17:08.429 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005643", "end": "2020-07-06 13:17:08.643148", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-06 13:17:08.637505", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:08.439 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-06T13:17:08.440 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.476 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.069) 0:01:38.574 *********** 2020-07-06T13:17:08.506 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.544 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.068) 0:01:38.643 *********** 2020-07-06T13:17:08.554 INFO:teuthology.task.ansible.out: 2020-07-06T13:17:08.556 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi118.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005537", "end": "2020-07-06 13:17:08.763756", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-06 13:17:08.758219", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:08.587 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.625 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.080) 0:01:38.724 *********** 2020-07-06T13:17:08.666 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-06T13:17:08.667 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.708 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.083) 0:01:38.807 *********** 2020-07-06T13:17:08.718 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-06T13:17:08.720 INFO:teuthology.task.ansible.out:ok: [smithi118.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025499", "end": "2020-07-06 13:17:08.900237", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-06 13:17:08.874738", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:08.760 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.051) 0:01:38.858 *********** 2020-07-06T13:17:08.923 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-06T13:17:08.926 INFO:teuthology.task.ansible.out:skipping: [smithi148.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-06T13:17:08.957 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:08 +0000 (0:00:00.197) 0:01:39.055 *********** 2020-07-06T13:17:08.968 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-06T13:17:09.005 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:09 +0000 (0:00:00.047) 0:01:39.103 *********** 2020-07-06T13:17:09.119 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-06T13:17:09.121 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010983", "end": "2020-07-06 13:17:09.319809", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-06 13:17:09.308826", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:09.141 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-06T13:17:09.143 INFO:teuthology.task.ansible.out:changed: [smithi118.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-07-06T13:17:09.254 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-06T13:17:09.255 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006132", "end": "2020-07-06 13:17:09.452002", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-06 13:17:09.445870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:09.381 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005591", "end": "2020-07-06 13:17:09.583134", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-06 13:17:09.577543", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:09.551 INFO:teuthology.task.ansible.out:ok: [smithi148.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.033557", "end": "2020-07-06 13:17:09.737795", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-06 13:17:09.704238", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-06T13:17:09.591 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:09 +0000 (0:00:00.586) 0:01:39.689 *********** 2020-07-06T13:17:09.621 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-06T13:17:09.661 INFO:teuthology.task.ansible.out:Monday 06 July 2020 13:17:09 +0000 (0:00:00.070) 0:01:39.760 *********** 2020-07-06T13:17:09.800 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-06T13:17:09.801 INFO:teuthology.task.ansible.out:changed: [smithi148.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-07-06T13:17:09.910 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-07-06T13:17:09.914 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-07-06T13:17:09.917 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-07-06T13:17:09.919 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi118.front.sepia.ceph.com : ok=108 changed=26 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 smithi148.front.sepia.ceph.com : ok=108 changed=26 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 Monday 06 July 2020 13:17:09 +0000 (0:00:00.256) 0:01:40.016 *********** =============================================================================== testnode : Ensure packages are not present. ----------------------------- 9.20s testnode : Zap all non-root disks --------------------------------------- 8.47s testnode : Install packages --------------------------------------------- 8.31s common : Update apt cache ----------------------------------------------- 3.24s testnode : Update apt cache. -------------------------------------------- 2.77s testnode : Install apt keys --------------------------------------------- 2.07s Gathering Facts --------------------------------------------------------- 1.91s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.62s testnode : Create logical volume(s) ------------------------------------- 1.61s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.90s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.88s common : Install Kerberos Packages (Debian) ----------------------------- 0.83s Gathering Facts --------------------------------------------------------- 0.83s common : Make sure smartmontools is installed --------------------------- 0.80s testnode : Set the system's hostname ------------------------------------ 0.79s common : Install nrpe package and dependencies (Ubuntu/Fedora) ---------- 0.79s testnode : Install python-apt ------------------------------------------- 0.79s testnode : Make sure apt dependencies are installed --------------------- 0.73s ansible-managed 2020-07-06T13:17:09.921 INFO:teuthology.task.ansible.out: : Create the cephlab_sudo sudoers.d file. --------------- 0.70s testnode : Upgrade packages --------------------------------------------- 0.68s 2020-07-06T13:17:10.281 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2020-07-06T13:17:10.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-06T13:17:10.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:17:10.362 INFO:teuthology.orchestra.run.smithi118:> true 2020-07-06T13:17:10.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-06T13:17:10.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-06T13:17:10.636 INFO:teuthology.orchestra.run.smithi148:> true 2020-07-06T13:17:10.834 INFO:teuthology.run_tasks:Running task clock... 2020-07-06T13:17:10.850 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-07-06T13:17:10.851 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-06T13:17:10.851 INFO:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-06T13:17:10.914 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-07-06T13:17:10.914 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Command line: ntpd -gq 2020-07-06T13:17:10.916 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: proto: precision = 0.123 usec (-23) 2020-07-06T13:17:10.916 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-07-06T13:17:10.917 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: restrict ::: KOD does nothing without LIMITED. 2020-07-06T13:17:10.917 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen and drop on 0 v6wildcard [::]:123 2020-07-06T13:17:10.917 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-07-06T13:17:10.917 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen normally on 2 lo 127.0.0.1:123 2020-07-06T13:17:10.917 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen normally on 3 enp3s0f1 172.21.15.118:123 2020-07-06T13:17:10.918 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen normally on 4 lo [::1]:123 2020-07-06T13:17:10.918 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d725%5]:123 2020-07-06T13:17:10.918 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:11 ntpd[6547]: Listening on routing socket on fd #22 for interface updates 2020-07-06T13:17:10.918 INFO:teuthology.orchestra.run.smithi118.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-07-06T13:17:10.918 INFO:teuthology.orchestra.run.smithi118.stderr:restrict ::: KOD does nothing without LIMITED. 2020-07-06T13:17:11.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:12 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:11.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:12 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:11.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:12 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:11.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:12 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:12.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:12.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:12.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:12.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:12.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:12.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:12.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:12.917 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:13 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:13.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:13.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:13.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:13.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:13.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:13.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:13.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:13.917 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:14 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:14.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:14.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:14.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:14.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:14.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:14.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:14.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:14.917 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:15 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:15.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:15.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:15.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:15.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:15.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:15.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:15.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:15.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:16 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:16.922 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:16.922 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:16.923 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:16.923 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:16.923 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:16.923 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:16.924 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:16.924 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:17.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:18 ntpd[6547]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:17.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:18 ntpd[6547]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:17.915 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:18 ntpd[6547]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:17.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:18 ntpd[6547]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:17.916 INFO:teuthology.orchestra.run.smithi118.stderr: 6 Jul 13:17:17 ntpd[6547]: can't open /var/log/ntpstats/loopstats.20200706: Permission denied 2020-07-06T13:17:17.916 INFO:teuthology.orchestra.run.smithi118.stdout: 6 Jul 13:17:17 ntpd[6547]: ntpd: time set -0.247087 s 2020-07-06T13:17:17.916 INFO:teuthology.orchestra.run.smithi118.stdout:ntpd: time set -0.247087s 2020-07-06T13:17:17.979 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2020-07-06T13:17:17.979 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2020-07-06T13:17:17.979 INFO:teuthology.orchestra.run.smithi118.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:17.980 INFO:teuthology.orchestra.run.smithi118.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:17.980 INFO:teuthology.orchestra.run.smithi118.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:17.980 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:17.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-06T13:17:17.982 INFO:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-06T13:17:18.032 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-07-06T13:17:18.033 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Command line: ntpd -gq 2020-07-06T13:17:18.034 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: proto: precision = 0.109 usec (-23) 2020-07-06T13:17:18.034 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-07-06T13:17:18.035 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: restrict ::: KOD does nothing without LIMITED. 2020-07-06T13:17:18.035 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen and drop on 0 v6wildcard [::]:123 2020-07-06T13:17:18.035 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-07-06T13:17:18.036 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen normally on 2 lo 127.0.0.1:123 2020-07-06T13:17:18.036 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2020-07-06T13:17:18.036 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen normally on 4 lo [::1]:123 2020-07-06T13:17:18.036 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2020-07-06T13:17:18.036 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:18 ntpd[6593]: Listening on routing socket on fd #22 for interface updates 2020-07-06T13:17:18.037 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-07-06T13:17:18.037 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2020-07-06T13:17:19.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:19.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:19.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:19.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:19.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:19.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:19.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:19.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:19 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:20.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:20 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:20.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:20 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:20.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:20 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:20.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:20 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:21.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:21.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:21.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:21.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:21.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:21.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:21.036 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:21 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:22.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:22 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:22.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:22 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:22.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:22 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:22.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:22 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:23.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:23.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:23.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:23.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:23.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:23.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:23.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:23.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:23.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:23.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:23.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:23.035 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:23 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:24.032 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:24 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:24.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:24 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:24.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:24 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:24.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:24 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:25.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:25 ntpd[6593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-07-06T13:17:25.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:25 ntpd[6593]: can't open /var/log/ntpstats/rawstats.20200706: Permission denied 2020-07-06T13:17:25.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:25 ntpd[6593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-07-06T13:17:25.033 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:25 ntpd[6593]: can't open /var/log/ntpstats/peerstats.20200706: Permission denied 2020-07-06T13:17:25.034 INFO:teuthology.orchestra.run.smithi148.stderr: 6 Jul 13:17:25 ntpd[6593]: can't open /var/log/ntpstats/loopstats.20200706: Permission denied 2020-07-06T13:17:25.034 INFO:teuthology.orchestra.run.smithi148.stdout: 6 Jul 13:17:25 ntpd[6593]: ntpd: time set -0.229762 s 2020-07-06T13:17:25.034 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time set -0.229762s 2020-07-06T13:17:25.121 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2020-07-06T13:17:25.122 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2020-07-06T13:17:25.122 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:25.122 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:25.123 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:25.123 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-07-06T13:17:25.125 INFO:teuthology.run_tasks:Running task install... 2020-07-06T13:17:25.136 DEBUG:teuthology.task.install:project ceph 2020-07-06T13:17:25.136 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'}} 2020-07-06T13:17:25.137 DEBUG:teuthology.task.install:config {'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm'], 'extra_packages': ['librados2'], 'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'} 2020-07-06T13:17:25.137 INFO:teuthology.task.install:Using flavor: basic 2020-07-06T13:17:25.143 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-07-06T13:17:25.144 INFO:teuthology.task.install:extra packages: ['librados2'] 2020-07-06T13:17:25.145 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:17:25.198 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:17:25.209 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:17:25.210 INFO:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2020-07-06T13:17:25.211 INFO:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2020-07-06T13:17:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2020-07-06T13:17:25.269 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:17:25.270 INFO:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2020-07-06T13:17:25.306 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-07-06T13:17:25.354 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-07-06T13:17:25.362 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-07-06T13:17:25.362 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2020-07-06T13:17:25.364 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:17:25.410 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-07-06T13:17:25.411 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2020-07-06T13:17:25.411 INFO:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2020-07-06T13:17:25.412 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:17:25.416 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:17:25.417 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-07-06T13:17:25.417 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-06T13:17:25.418 INFO:teuthology.packaging:ref: None 2020-07-06T13:17:25.418 INFO:teuthology.packaging:tag: None 2020-07-06T13:17:25.418 INFO:teuthology.packaging:branch: mimic 2020-07-06T13:17:25.419 INFO:teuthology.packaging:sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:17:25.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-07-06T13:17:25.462 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2020-07-06T13:17:25.467 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:17:25.468 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-07-06T13:17:25.468 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-06T13:17:25.468 INFO:teuthology.packaging:ref: None 2020-07-06T13:17:25.468 INFO:teuthology.packaging:tag: None 2020-07-06T13:17:25.469 INFO:teuthology.packaging:branch: mimic 2020-07-06T13:17:25.469 INFO:teuthology.packaging:sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:17:25.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-07-06T13:17:25.710 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default/ 2020-07-06T13:17:25.710 INFO:teuthology.task.install.deb:Package version is 13.2.10-1bionic 2020-07-06T13:17:25.765 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-07-06T13:17:25.774 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default/ 2020-07-06T13:17:25.774 INFO:teuthology.task.install.deb:Package version is 13.2.10-1bionic 2020-07-06T13:17:25.803 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-07-06T13:17:25.813 INFO:teuthology.orchestra.run.smithi118:> sudo apt-get update 2020-07-06T13:17:25.851 INFO:teuthology.orchestra.run.smithi148:> sudo apt-get update 2020-07-06T13:17:26.018 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:1 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic InRelease 2020-07-06T13:17:26.023 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic Release [7,660 B] 2020-07-06T13:17:26.024 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:3 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic Release.gpg 2020-07-06T13:17:26.024 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main i386 Packages [768 B] 2020-07-06T13:17:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:1 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic InRelease 2020-07-06T13:17:26.037 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 Packages [14.0 kB] 2020-07-06T13:17:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic Release [7,660 B] 2020-07-06T13:17:26.038 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:3 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic Release.gpg 2020-07-06T13:17:26.039 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main i386 Packages [768 B] 2020-07-06T13:17:26.050 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 Packages [14.0 kB] 2020-07-06T13:17:26.119 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:6 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-07-06T13:17:26.159 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:6 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-07-06T13:17:26.188 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-07-06T13:17:26.189 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-07-06T13:17:26.268 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-07-06T13:17:26.269 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-07-06T13:17:26.347 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-07-06T13:17:26.348 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-07-06T13:17:26.719 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 22.5 kB in 1s (32.0 kB/s) 2020-07-06T13:17:26.754 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 22.5 kB in 1s (31.9 kB/s) 2020-07-06T13:17:27.906 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:17:27.945 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2020-07-06T13:17:27.951 INFO:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.10-1bionic ceph-mds=13.2.10-1bionic ceph-mgr=13.2.10-1bionic ceph-common=13.2.10-1bionic ceph-fuse=13.2.10-1bionic ceph-test=13.2.10-1bionic radosgw=13.2.10-1bionic python3-rados=13.2.10-1bionic python3-rgw=13.2.10-1bionic python3-cephfs=13.2.10-1bionic python3-rbd=13.2.10-1bionic libcephfs2=13.2.10-1bionic libcephfs-dev=13.2.10-1bionic librados2=13.2.10-1bionic librbd1=13.2.10-1bionic rbd-fuse=13.2.10-1bionic librados2=13.2.10-1bionic 2020-07-06T13:17:27.990 INFO:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.10-1bionic ceph-mds=13.2.10-1bionic ceph-mgr=13.2.10-1bionic ceph-common=13.2.10-1bionic ceph-fuse=13.2.10-1bionic ceph-test=13.2.10-1bionic radosgw=13.2.10-1bionic python3-rados=13.2.10-1bionic python3-rgw=13.2.10-1bionic python3-cephfs=13.2.10-1bionic python3-rbd=13.2.10-1bionic libcephfs2=13.2.10-1bionic libcephfs-dev=13.2.10-1bionic librados2=13.2.10-1bionic librbd1=13.2.10-1bionic rbd-fuse=13.2.10-1bionic librados2=13.2.10-1bionic 2020-07-06T13:17:28.031 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:17:28.073 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2020-07-06T13:17:28.281 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2020-07-06T13:17:28.282 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2020-07-06T13:17:28.322 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2020-07-06T13:17:28.323 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2020-07-06T13:17:28.439 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2020-07-06T13:17:28.440 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-07-06T13:17:28.440 INFO:teuthology.orchestra.run.smithi118.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-07-06T13:17:28.441 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-07-06T13:17:28.441 INFO:teuthology.orchestra.run.smithi118.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-07-06T13:17:28.441 INFO:teuthology.orchestra.run.smithi118.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-07-06T13:17:28.441 INFO:teuthology.orchestra.run.smithi118.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-07-06T13:17:28.441 INFO:teuthology.orchestra.run.smithi118.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-07-06T13:17:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-07-06T13:17:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-07-06T13:17:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-07-06T13:17:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-07-06T13:17:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-07-06T13:17:28.443 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse socat xmlstarlet 2020-07-06T13:17:28.443 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2020-07-06T13:17:28.443 INFO:teuthology.orchestra.run.smithi118.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-07-06T13:17:28.443 INFO:teuthology.orchestra.run.smithi118.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-07-06T13:17:28.444 INFO:teuthology.orchestra.run.smithi118.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-07-06T13:17:28.444 INFO:teuthology.orchestra.run.smithi118.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-07-06T13:17:28.444 INFO:teuthology.orchestra.run.smithi118.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-07-06T13:17:28.444 INFO:teuthology.orchestra.run.smithi118.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-07-06T13:17:28.444 INFO:teuthology.orchestra.run.smithi118.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-07-06T13:17:28.445 INFO:teuthology.orchestra.run.smithi118.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-07-06T13:17:28.483 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2020-07-06T13:17:28.484 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-07-06T13:17:28.484 INFO:teuthology.orchestra.run.smithi148.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-07-06T13:17:28.484 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-07-06T13:17:28.485 INFO:teuthology.orchestra.run.smithi148.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-07-06T13:17:28.485 INFO:teuthology.orchestra.run.smithi148.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-07-06T13:17:28.485 INFO:teuthology.orchestra.run.smithi148.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-07-06T13:17:28.485 INFO:teuthology.orchestra.run.smithi148.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-07-06T13:17:28.485 INFO:teuthology.orchestra.run.smithi148.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-07-06T13:17:28.486 INFO:teuthology.orchestra.run.smithi148.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-07-06T13:17:28.486 INFO:teuthology.orchestra.run.smithi148.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-07-06T13:17:28.486 INFO:teuthology.orchestra.run.smithi148.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-07-06T13:17:28.486 INFO:teuthology.orchestra.run.smithi148.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-07-06T13:17:28.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse socat xmlstarlet 2020-07-06T13:17:28.487 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2020-07-06T13:17:28.487 INFO:teuthology.orchestra.run.smithi148.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-07-06T13:17:28.488 INFO:teuthology.orchestra.run.smithi148.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-07-06T13:17:28.488 INFO:teuthology.orchestra.run.smithi148.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-07-06T13:17:28.488 INFO:teuthology.orchestra.run.smithi148.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-07-06T13:17:28.488 INFO:teuthology.orchestra.run.smithi148.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-07-06T13:17:28.488 INFO:teuthology.orchestra.run.smithi148.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-07-06T13:17:28.489 INFO:teuthology.orchestra.run.smithi148.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-07-06T13:17:28.489 INFO:teuthology.orchestra.run.smithi148.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-07-06T13:17:28.524 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2020-07-06T13:17:28.524 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-07-06T13:17:28.525 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-07-06T13:17:28.525 INFO:teuthology.orchestra.run.smithi118.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-07-06T13:17:28.525 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-07-06T13:17:28.526 INFO:teuthology.orchestra.run.smithi118.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-07-06T13:17:28.526 INFO:teuthology.orchestra.run.smithi118.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-07-06T13:17:28.526 INFO:teuthology.orchestra.run.smithi118.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-07-06T13:17:28.526 INFO:teuthology.orchestra.run.smithi118.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-07-06T13:17:28.526 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-07-06T13:17:28.527 INFO:teuthology.orchestra.run.smithi118.stdout: radosgw rbd-fuse socat xmlstarlet 2020-07-06T13:17:28.528 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2020-07-06T13:17:28.528 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 librbd1 2020-07-06T13:17:28.568 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2020-07-06T13:17:28.569 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-07-06T13:17:28.570 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-07-06T13:17:28.570 INFO:teuthology.orchestra.run.smithi148.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-07-06T13:17:28.570 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-07-06T13:17:28.571 INFO:teuthology.orchestra.run.smithi148.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-07-06T13:17:28.571 INFO:teuthology.orchestra.run.smithi148.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-07-06T13:17:28.571 INFO:teuthology.orchestra.run.smithi148.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-07-06T13:17:28.571 INFO:teuthology.orchestra.run.smithi148.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-07-06T13:17:28.571 INFO:teuthology.orchestra.run.smithi148.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-07-06T13:17:28.572 INFO:teuthology.orchestra.run.smithi148.stdout: radosgw rbd-fuse socat xmlstarlet 2020-07-06T13:17:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:2 upgraded, 74 newly installed, 0 to remove and 1 not upgraded. 2020-07-06T13:17:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 74.8 MB of archives. 2020-07-06T13:17:28.574 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 302 MB of additional disk space will be used. 2020-07-06T13:17:28.574 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.10-1bionic [1,085 kB] 2020-07-06T13:17:28.574 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2020-07-06T13:17:28.574 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 librbd1 2020-07-06T13:17:28.582 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.10-1bionic [2,601 kB] 2020-07-06T13:17:28.607 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.10-1bionic [386 kB] 2020-07-06T13:17:28.610 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.10-1bionic [289 kB] 2020-07-06T13:17:28.613 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.10-1bionic [19.0 kB] 2020-07-06T13:17:28.613 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.10-1bionic [93.7 kB] 2020-07-06T13:17:28.614 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.10-1bionic [179 kB] 2020-07-06T13:17:28.615 INFO:teuthology.orchestra.run.smithi148.stdout:2 upgraded, 74 newly installed, 0 to remove and 1 not upgraded. 2020-07-06T13:17:28.616 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 74.8 MB of archives. 2020-07-06T13:17:28.616 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 302 MB of additional disk space will be used. 2020-07-06T13:17:28.616 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.10-1bionic [1,085 kB] 2020-07-06T13:17:28.617 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.10-1bionic [1,881 kB] 2020-07-06T13:17:28.626 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.10-1bionic [2,601 kB] 2020-07-06T13:17:28.633 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.10-1bionic [98.6 kB] 2020-07-06T13:17:28.634 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.10-1bionic [305 kB] 2020-07-06T13:17:28.637 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.10-1bionic [12.0 MB] 2020-07-06T13:17:28.661 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.10-1bionic [386 kB] 2020-07-06T13:17:28.664 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.10-1bionic [289 kB] 2020-07-06T13:17:28.668 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.10-1bionic [19.0 kB] 2020-07-06T13:17:28.669 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.10-1bionic [93.7 kB] 2020-07-06T13:17:28.669 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.10-1bionic [179 kB] 2020-07-06T13:17:28.670 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.10-1bionic [1,881 kB] 2020-07-06T13:17:28.688 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.10-1bionic [98.6 kB] 2020-07-06T13:17:28.689 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.10-1bionic [305 kB] 2020-07-06T13:17:28.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.10-1bionic [12.0 MB] 2020-07-06T13:17:28.714 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-07-06T13:17:28.749 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.10-1bionic [3,644 kB] 2020-07-06T13:17:28.757 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-07-06T13:17:28.777 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.10-1bionic [2,737 kB] 2020-07-06T13:17:28.802 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.10-1bionic [2,907 kB] 2020-07-06T13:17:28.805 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.10-1bionic [3,644 kB] 2020-07-06T13:17:28.829 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.10-1bionic [13.2 MB] 2020-07-06T13:17:28.840 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.10-1bionic [2,737 kB] 2020-07-06T13:17:28.866 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.10-1bionic [2,907 kB] 2020-07-06T13:17:28.893 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.10-1bionic [13.2 MB] 2020-07-06T13:17:28.948 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.10-1bionic [3,856 B] 2020-07-06T13:17:28.948 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.10-1bionic [459 kB] 2020-07-06T13:17:28.952 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.10-1bionic [1,645 kB] 2020-07-06T13:17:28.968 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.10-1bionic [22.3 MB] 2020-07-06T13:17:29.012 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.10-1bionic [3,856 B] 2020-07-06T13:17:29.013 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.10-1bionic [459 kB] 2020-07-06T13:17:29.016 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.10-1bionic [1,645 kB] 2020-07-06T13:17:29.031 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.10-1bionic [22.3 MB] 2020-07-06T13:17:29.074 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-07-06T13:17:29.075 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-07-06T13:17:29.117 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-07-06T13:17:29.120 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-07-06T13:17:29.125 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-07-06T13:17:29.150 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-07-06T13:17:29.170 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.10-1bionic [16.4 kB] 2020-07-06T13:17:29.170 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.10-1bionic [19.3 kB] 2020-07-06T13:17:29.171 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.10-1bionic [306 kB] 2020-07-06T13:17:29.173 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.10-1bionic [97.1 kB] 2020-07-06T13:17:29.174 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.10-1bionic [179 kB] 2020-07-06T13:17:29.176 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.10-1bionic [104 kB] 2020-07-06T13:17:29.177 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.10-1bionic [3,218 kB] 2020-07-06T13:17:29.178 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-07-06T13:17:29.199 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-07-06T13:17:29.207 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.10-1bionic [13.7 kB] 2020-07-06T13:17:29.214 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-07-06T13:17:29.219 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-07-06T13:17:29.226 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-07-06T13:17:29.230 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.10-1bionic [16.4 kB] 2020-07-06T13:17:29.231 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.10-1bionic [19.3 kB] 2020-07-06T13:17:29.231 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.10-1bionic [306 kB] 2020-07-06T13:17:29.232 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-07-06T13:17:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.10-1bionic [97.1 kB] 2020-07-06T13:17:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-07-06T13:17:29.235 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.10-1bionic [179 kB] 2020-07-06T13:17:29.236 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.10-1bionic [104 kB] 2020-07-06T13:17:29.237 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.10-1bionic [3,218 kB] 2020-07-06T13:17:29.249 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-07-06T13:17:29.256 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-07-06T13:17:29.258 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-07-06T13:17:29.267 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 https://chacra.ceph.com/r/ceph/mimic/564bdc4ae87418a232fc901524470e1a0f76d641/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.10-1bionic [13.7 kB] 2020-07-06T13:17:29.273 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-07-06T13:17:29.283 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-07-06T13:17:29.285 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-07-06T13:17:29.297 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-07-06T13:17:29.298 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-07-06T13:17:29.311 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-07-06T13:17:29.312 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-07-06T13:17:29.317 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-07-06T13:17:29.318 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-07-06T13:17:29.319 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-07-06T13:17:29.320 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-07-06T13:17:29.333 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-07-06T13:17:29.355 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-07-06T13:17:29.356 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-07-06T13:17:29.360 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-07-06T13:17:29.362 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-07-06T13:17:29.363 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-07-06T13:17:29.391 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-07-06T13:17:29.393 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-07-06T13:17:29.398 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-07-06T13:17:29.401 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-07-06T13:17:29.403 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-07-06T13:17:29.408 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-07-06T13:17:29.435 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-07-06T13:17:29.438 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-07-06T13:17:29.442 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-07-06T13:17:29.445 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-07-06T13:17:29.449 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-07-06T13:17:29.470 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-07-06T13:17:29.473 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-07-06T13:17:29.474 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-07-06T13:17:29.500 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-07-06T13:17:29.514 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-07-06T13:17:29.517 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-07-06T13:17:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-07-06T13:17:29.534 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-07-06T13:17:29.535 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-07-06T13:17:29.549 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-07-06T13:17:29.550 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-07-06T13:17:29.552 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-07-06T13:17:29.556 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-07-06T13:17:29.558 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-07-06T13:17:29.567 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-07-06T13:17:29.594 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-07-06T13:17:29.595 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-07-06T13:17:29.599 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-07-06T13:17:29.600 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-07-06T13:17:29.606 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-07-06T13:17:29.629 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-07-06T13:17:29.634 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-07-06T13:17:29.635 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-07-06T13:17:29.651 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-07-06T13:17:29.673 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-07-06T13:17:29.678 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-07-06T13:17:29.680 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-07-06T13:17:29.694 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-07-06T13:17:29.701 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-07-06T13:17:29.708 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-07-06T13:17:29.726 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-07-06T13:17:29.728 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-07-06T13:17:29.732 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-07-06T13:17:29.733 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-07-06T13:17:29.736 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-07-06T13:17:29.754 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-07-06T13:17:29.755 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-07-06T13:17:29.758 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-07-06T13:17:29.759 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-07-06T13:17:29.763 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-07-06T13:17:29.788 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-07-06T13:17:29.790 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-07-06T13:17:29.792 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-07-06T13:17:29.793 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-07-06T13:17:29.832 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-07-06T13:17:29.835 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-07-06T13:17:29.837 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-07-06T13:17:29.838 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-07-06T13:17:29.838 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-07-06T13:17:29.867 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-07-06T13:17:29.869 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-07-06T13:17:29.911 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-07-06T13:17:30.444 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 74.8 MB in 1s (56.8 MB/s) 2020-07-06T13:17:30.501 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 74.8 MB in 1s (56.9 MB/s) 2020-07-06T13:17:30.612 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-07-06T13:17:30.634 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-07-06T13:17:30.649 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102031 files and directories currently installed.) 2020-07-06T13:17:30.652 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-07-06T13:17:30.670 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102031 files and directories currently installed.) 2020-07-06T13:17:30.673 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-07-06T13:17:30.742 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-07-06T13:17:30.743 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-07-06T13:17:31.055 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../01-librbd1_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:31.110 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../01-librbd1_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (13.2.10-1bionic) over (12.2.13-0ubuntu0.18.04.2) ... 2020-07-06T13:17:31.215 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (13.2.10-1bionic) over (12.2.13-0ubuntu0.18.04.2) ... 2020-07-06T13:17:31.651 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../02-librados2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:31.673 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../02-librados2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:31.757 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (13.2.10-1bionic) over (12.2.13-0ubuntu0.18.04.2) ... 2020-07-06T13:17:31.795 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (13.2.10-1bionic) over (12.2.13-0ubuntu0.18.04.2) ... 2020-07-06T13:17:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2020-07-06T13:17:32.322 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../03-libcephfs2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:32.357 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs2. 2020-07-06T13:17:32.364 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (13.2.10-1bionic) ... 2020-07-06T13:17:32.370 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../03-libcephfs2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:32.415 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (13.2.10-1bionic) ... 2020-07-06T13:17:32.643 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-rados. 2020-07-06T13:17:32.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../04-python-rados_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-rados. 2020-07-06T13:17:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../04-python-rados_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:32.684 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-rados (13.2.10-1bionic) ... 2020-07-06T13:17:32.713 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-rados (13.2.10-1bionic) ... 2020-07-06T13:17:32.971 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-ceph-argparse. 2020-07-06T13:17:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.007 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-ceph-argparse. 2020-07-06T13:17:33.019 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.020 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:17:33.057 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:17:33.294 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-cephfs. 2020-07-06T13:17:33.304 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../06-python-cephfs_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.323 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-cephfs. 2020-07-06T13:17:33.335 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-cephfs (13.2.10-1bionic) ... 2020-07-06T13:17:33.335 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../06-python-cephfs_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.373 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-cephfs (13.2.10-1bionic) ... 2020-07-06T13:17:33.646 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-prettytable. 2020-07-06T13:17:33.651 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-prettytable. 2020-07-06T13:17:33.658 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-07-06T13:17:33.663 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-07-06T13:17:33.693 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-07-06T13:17:33.696 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-07-06T13:17:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-rbd. 2020-07-06T13:17:33.954 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-rbd. 2020-07-06T13:17:33.959 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../08-python-rbd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.965 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../08-python-rbd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:33.999 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-rbd (13.2.10-1bionic) ... 2020-07-06T13:17:34.004 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-rbd (13.2.10-1bionic) ... 2020-07-06T13:17:34.293 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-certifi. 2020-07-06T13:17:34.303 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-07-06T13:17:34.331 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-certifi. 2020-07-06T13:17:34.342 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-07-06T13:17:34.343 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-07-06T13:17:34.382 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-07-06T13:17:34.620 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-chardet. 2020-07-06T13:17:34.632 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-07-06T13:17:34.664 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-07-06T13:17:34.684 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-chardet. 2020-07-06T13:17:34.695 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-07-06T13:17:34.734 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-07-06T13:17:35.080 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-urllib3. 2020-07-06T13:17:35.090 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-urllib3. 2020-07-06T13:17:35.092 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-07-06T13:17:35.102 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-07-06T13:17:35.121 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-07-06T13:17:35.140 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-07-06T13:17:35.416 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-requests. 2020-07-06T13:17:35.427 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-07-06T13:17:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-07-06T13:17:35.460 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-requests. 2020-07-06T13:17:35.472 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-07-06T13:17:35.510 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-07-06T13:17:35.711 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librgw2. 2020-07-06T13:17:35.723 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../13-librgw2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:35.752 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (13.2.10-1bionic) ... 2020-07-06T13:17:35.821 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2020-07-06T13:17:35.836 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../13-librgw2_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:35.871 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (13.2.10-1bionic) ... 2020-07-06T13:17:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-rgw. 2020-07-06T13:17:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../14-python-rgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-rgw (13.2.10-1bionic) ... 2020-07-06T13:17:36.265 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-rgw. 2020-07-06T13:17:36.276 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../14-python-rgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:36.307 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-rgw (13.2.10-1bionic) ... 2020-07-06T13:17:36.516 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liboath0. 2020-07-06T13:17:36.529 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-07-06T13:17:36.566 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-07-06T13:17:36.668 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0. 2020-07-06T13:17:36.679 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-07-06T13:17:36.718 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-07-06T13:17:36.894 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libradosstriper1. 2020-07-06T13:17:36.910 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../16-libradosstriper1_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:36.944 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (13.2.10-1bionic) ... 2020-07-06T13:17:37.029 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2020-07-06T13:17:37.040 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../16-libradosstriper1_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:37.079 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (13.2.10-1bionic) ... 2020-07-06T13:17:37.331 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-common. 2020-07-06T13:17:37.342 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../17-ceph-common_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:37.372 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (13.2.10-1bionic) ... 2020-07-06T13:17:37.467 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2020-07-06T13:17:37.476 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../17-ceph-common_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (13.2.10-1bionic) ... 2020-07-06T13:17:38.544 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-07-06T13:17:38.557 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-07-06T13:17:38.594 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-07-06T13:17:38.695 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-07-06T13:17:38.707 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-07-06T13:17:38.745 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-07-06T13:17:38.872 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-07-06T13:17:38.883 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-07-06T13:17:38.922 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-07-06T13:17:39.014 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-07-06T13:17:39.025 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-07-06T13:17:39.064 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-07-06T13:17:39.301 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-base. 2020-07-06T13:17:39.313 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../20-ceph-base_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:39.360 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (13.2.10-1bionic) ... 2020-07-06T13:17:39.493 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2020-07-06T13:17:39.506 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../20-ceph-base_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:39.552 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (13.2.10-1bionic) ... 2020-07-06T13:17:40.148 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-cherrypy3. 2020-07-06T13:17:40.160 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-07-06T13:17:40.198 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-07-06T13:17:40.265 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-cherrypy3. 2020-07-06T13:17:40.275 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-07-06T13:17:40.315 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-07-06T13:17:40.518 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-markupsafe. 2020-07-06T13:17:40.530 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-07-06T13:17:40.568 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-07-06T13:17:40.676 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-markupsafe. 2020-07-06T13:17:40.687 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-07-06T13:17:40.726 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-07-06T13:17:40.813 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-jinja2. 2020-07-06T13:17:40.823 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-07-06T13:17:40.854 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:17:40.987 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-jinja2. 2020-07-06T13:17:41.000 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-07-06T13:17:41.029 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:17:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-openssl. 2020-07-06T13:17:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-07-06T13:17:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:17:41.349 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-openssl. 2020-07-06T13:17:41.359 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-07-06T13:17:41.390 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:17:41.518 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-logutils. 2020-07-06T13:17:41.530 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-07-06T13:17:41.568 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-07-06T13:17:41.685 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-logutils. 2020-07-06T13:17:41.695 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-07-06T13:17:41.734 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-07-06T13:17:41.880 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-mako. 2020-07-06T13:17:41.891 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-07-06T13:17:41.930 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-07-06T13:17:42.020 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-mako. 2020-07-06T13:17:42.033 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-07-06T13:17:42.070 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-07-06T13:17:42.283 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-simplegeneric. 2020-07-06T13:17:42.294 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-07-06T13:17:42.335 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-07-06T13:17:42.407 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-simplegeneric. 2020-07-06T13:17:42.419 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-07-06T13:17:42.457 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-07-06T13:17:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-singledispatch. 2020-07-06T13:17:42.630 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-07-06T13:17:42.661 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-07-06T13:17:42.710 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-singledispatch. 2020-07-06T13:17:42.722 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-07-06T13:17:42.751 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-07-06T13:17:42.955 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-simplejson. 2020-07-06T13:17:42.968 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-07-06T13:17:43.005 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-07-06T13:17:43.062 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-simplejson. 2020-07-06T13:17:43.073 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-07-06T13:17:43.112 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-07-06T13:17:43.325 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-webob. 2020-07-06T13:17:43.336 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-07-06T13:17:43.375 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:17:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-webob. 2020-07-06T13:17:43.469 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-07-06T13:17:43.509 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:17:43.661 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-bs4. 2020-07-06T13:17:43.673 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-07-06T13:17:43.711 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-07-06T13:17:43.811 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-bs4. 2020-07-06T13:17:43.823 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-07-06T13:17:43.861 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-07-06T13:17:44.038 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-waitress. 2020-07-06T13:17:44.042 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-07-06T13:17:44.072 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-07-06T13:17:44.156 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-waitress. 2020-07-06T13:17:44.168 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-07-06T13:17:44.206 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-07-06T13:17:44.343 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-dnspython. 2020-07-06T13:17:44.353 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-07-06T13:17:44.384 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-07-06T13:17:44.484 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-dnspython. 2020-07-06T13:17:44.496 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-07-06T13:17:44.526 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-07-06T13:17:44.654 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package formencode-i18n. 2020-07-06T13:17:44.665 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-07-06T13:17:44.704 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-07-06T13:17:44.804 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package formencode-i18n. 2020-07-06T13:17:44.814 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-07-06T13:17:44.845 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-07-06T13:17:44.973 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-formencode. 2020-07-06T13:17:44.985 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-07-06T13:17:45.023 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-07-06T13:17:45.114 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-formencode. 2020-07-06T13:17:45.126 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-07-06T13:17:45.164 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-07-06T13:17:45.351 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-tempita. 2020-07-06T13:17:45.362 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-07-06T13:17:45.401 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-07-06T13:17:45.475 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-tempita. 2020-07-06T13:17:45.487 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-07-06T13:17:45.526 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-07-06T13:17:45.705 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-paste. 2020-07-06T13:17:45.716 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-07-06T13:17:45.754 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:17:45.828 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-paste. 2020-07-06T13:17:45.839 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-07-06T13:17:45.878 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:17:46.058 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-07-06T13:17:46.068 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-07-06T13:17:46.108 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-07-06T13:17:46.190 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-07-06T13:17:46.200 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-07-06T13:17:46.257 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-07-06T13:17:46.410 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy. 2020-07-06T13:17:46.423 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-07-06T13:17:46.460 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-07-06T13:17:46.550 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy. 2020-07-06T13:17:46.561 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-07-06T13:17:46.609 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-07-06T13:17:46.797 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-webtest. 2020-07-06T13:17:46.809 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-07-06T13:17:46.847 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:17:46.879 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-webtest. 2020-07-06T13:17:46.889 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-07-06T13:17:46.920 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:17:47.141 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pecan. 2020-07-06T13:17:47.151 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-07-06T13:17:47.194 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-07-06T13:17:47.265 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pecan. 2020-07-06T13:17:47.276 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-07-06T13:17:47.317 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-07-06T13:17:47.549 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-bcrypt. 2020-07-06T13:17:47.559 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-07-06T13:17:47.599 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-07-06T13:17:47.653 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-bcrypt. 2020-07-06T13:17:47.664 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-07-06T13:17:47.703 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-07-06T13:17:47.893 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-werkzeug. 2020-07-06T13:17:47.905 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-07-06T13:17:47.954 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:17:48.005 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-werkzeug. 2020-07-06T13:17:48.016 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-07-06T13:17:48.055 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:17:48.355 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr. 2020-07-06T13:17:48.366 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../44-ceph-mgr_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:48.406 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (13.2.10-1bionic) ... 2020-07-06T13:17:48.442 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2020-07-06T13:17:48.453 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../44-ceph-mgr_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:48.492 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (13.2.10-1bionic) ... 2020-07-06T13:17:49.082 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mon. 2020-07-06T13:17:49.094 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../45-ceph-mon_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:49.132 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (13.2.10-1bionic) ... 2020-07-06T13:17:49.177 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2020-07-06T13:17:49.189 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../45-ceph-mon_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:49.226 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (13.2.10-1bionic) ... 2020-07-06T13:17:49.828 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-osd. 2020-07-06T13:17:49.840 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../46-ceph-osd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:49.878 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (13.2.10-1bionic) ... 2020-07-06T13:17:49.896 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2020-07-06T13:17:49.908 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../46-ceph-osd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:49.946 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (13.2.10-1bionic) ... 2020-07-06T13:17:51.183 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph. 2020-07-06T13:17:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2020-07-06T13:17:51.196 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../47-ceph_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:51.197 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../47-ceph_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:51.233 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (13.2.10-1bionic) ... 2020-07-06T13:17:51.235 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (13.2.10-1bionic) ... 2020-07-06T13:17:51.470 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2020-07-06T13:17:51.481 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../48-ceph-fuse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:51.545 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (13.2.10-1bionic) ... 2020-07-06T13:17:51.552 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-fuse. 2020-07-06T13:17:51.565 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../48-ceph-fuse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:51.603 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (13.2.10-1bionic) ... 2020-07-06T13:17:51.973 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mds. 2020-07-06T13:17:51.974 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2020-07-06T13:17:51.987 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../49-ceph-mds_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:51.987 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../49-ceph-mds_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:52.015 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (13.2.10-1bionic) ... 2020-07-06T13:17:52.024 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (13.2.10-1bionic) ... 2020-07-06T13:17:52.452 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig4:amd64. 2020-07-06T13:17:52.463 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-07-06T13:17:52.502 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-07-06T13:17:52.510 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libonig4:amd64. 2020-07-06T13:17:52.522 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-07-06T13:17:52.560 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-07-06T13:17:52.821 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2020-07-06T13:17:52.832 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-07-06T13:17:52.871 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-07-06T13:17:52.913 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjq1:amd64. 2020-07-06T13:17:52.925 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-07-06T13:17:52.963 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-07-06T13:17:53.132 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2020-07-06T13:17:53.143 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-07-06T13:17:53.182 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-07-06T13:17:53.216 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package jq. 2020-07-06T13:17:53.227 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-07-06T13:17:53.258 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-07-06T13:17:53.435 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2020-07-06T13:17:53.448 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-07-06T13:17:53.485 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-07-06T13:17:53.494 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package socat. 2020-07-06T13:17:53.504 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-07-06T13:17:53.544 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-07-06T13:17:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-07-06T13:17:53.850 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-07-06T13:17:53.888 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-07-06T13:17:53.931 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-07-06T13:17:53.942 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-07-06T13:17:53.990 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-07-06T13:17:54.133 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2020-07-06T13:17:54.145 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-07-06T13:17:54.182 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-07-06T13:17:54.259 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package xmlstarlet. 2020-07-06T13:17:54.271 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-07-06T13:17:54.309 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-07-06T13:17:54.495 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2020-07-06T13:17:54.508 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../56-ceph-test_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:54.536 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (13.2.10-1bionic) ... 2020-07-06T13:17:54.643 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-test. 2020-07-06T13:17:54.650 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../56-ceph-test_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:54.688 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (13.2.10-1bionic) ... 2020-07-06T13:17:56.459 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs-dev. 2020-07-06T13:17:56.470 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:56.507 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2020-07-06T13:17:56.509 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (13.2.10-1bionic) ... 2020-07-06T13:17:56.518 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:17:56.556 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (13.2.10-1bionic) ... 2020-07-06T13:17:56.778 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjs-underscore. 2020-07-06T13:17:56.790 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-07-06T13:17:56.809 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjs-underscore. 2020-07-06T13:17:56.821 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-07-06T13:17:56.828 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-07-06T13:17:56.859 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-07-06T13:17:57.106 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-07-06T13:17:57.119 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-07-06T13:17:57.128 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-07-06T13:17:57.140 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-07-06T13:17:57.156 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-07-06T13:17:57.170 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-07-06T13:17:57.430 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-webencodings. 2020-07-06T13:17:57.443 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-07-06T13:17:57.451 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-webencodings. 2020-07-06T13:17:57.464 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-07-06T13:17:57.481 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-webencodings (0.5-2) ... 2020-07-06T13:17:57.492 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-webencodings (0.5-2) ... 2020-07-06T13:17:57.770 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-html5lib. 2020-07-06T13:17:57.782 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-07-06T13:17:57.800 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-html5lib. 2020-07-06T13:17:57.811 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-07-06T13:17:57.820 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-07-06T13:17:57.850 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-07-06T13:17:58.165 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-lxml:amd64. 2020-07-06T13:17:58.178 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-07-06T13:17:58.186 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-lxml:amd64. 2020-07-06T13:17:58.198 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-07-06T13:17:58.237 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:17:58.241 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:17:58.664 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-openid. 2020-07-06T13:17:58.677 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-07-06T13:17:58.678 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-openid. 2020-07-06T13:17:58.689 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-07-06T13:17:58.714 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-openid (2.2.5-6) ... 2020-07-06T13:17:58.727 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-openid (2.2.5-6) ... 2020-07-06T13:17:59.043 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastescript. 2020-07-06T13:17:59.053 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-07-06T13:17:59.089 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastescript. 2020-07-06T13:17:59.092 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-07-06T13:17:59.100 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-07-06T13:17:59.139 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-07-06T13:17:59.421 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pyinotify. 2020-07-06T13:17:59.433 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-07-06T13:17:59.471 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-07-06T13:17:59.493 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pyinotify. 2020-07-06T13:17:59.505 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-07-06T13:17:59.543 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-07-06T13:17:59.757 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-repoze.lru. 2020-07-06T13:17:59.770 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-07-06T13:17:59.807 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-07-06T13:17:59.829 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-repoze.lru. 2020-07-06T13:17:59.843 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-07-06T13:17:59.871 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-07-06T13:18:00.102 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-routes. 2020-07-06T13:18:00.113 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-07-06T13:18:00.161 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-routes (2.4.1-1) ... 2020-07-06T13:18:00.183 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-routes. 2020-07-06T13:18:00.196 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-07-06T13:18:00.233 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-routes (2.4.1-1) ... 2020-07-06T13:18:00.496 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-scgi. 2020-07-06T13:18:00.508 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-07-06T13:18:00.544 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-scgi. 2020-07-06T13:18:00.546 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-07-06T13:18:00.557 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-07-06T13:18:00.594 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-07-06T13:18:01.558 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-07-06T13:18:01.571 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:01.608 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:01.656 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-07-06T13:18:01.668 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:01.706 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:01.835 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2020-07-06T13:18:01.847 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../70-python3-rados_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:01.885 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (13.2.10-1bionic) ... 2020-07-06T13:18:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rados. 2020-07-06T13:18:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../70-python3-rados_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.009 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (13.2.10-1bionic) ... 2020-07-06T13:18:02.230 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2020-07-06T13:18:02.242 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../71-python3-cephfs_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.279 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:02.320 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cephfs. 2020-07-06T13:18:02.333 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../71-python3-cephfs_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.370 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:02.540 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2020-07-06T13:18:02.551 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../72-python3-rbd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.590 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:02.656 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rbd. 2020-07-06T13:18:02.669 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../72-python3-rbd_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.706 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:02.838 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2020-07-06T13:18:02.847 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../73-python3-rgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:02.876 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:02.992 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rgw. 2020-07-06T13:18:03.005 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../73-python3-rgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:03.042 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:03.237 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2020-07-06T13:18:03.249 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../74-radosgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:03.287 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (13.2.10-1bionic) ... 2020-07-06T13:18:03.354 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package radosgw. 2020-07-06T13:18:03.367 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../74-radosgw_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:03.412 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (13.2.10-1bionic) ... 2020-07-06T13:18:03.832 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2020-07-06T13:18:03.845 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../75-rbd-fuse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:03.882 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:03.991 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package rbd-fuse. 2020-07-06T13:18:04.004 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../75-rbd-fuse_13.2.10-1bionic_amd64.deb ... 2020-07-06T13:18:04.041 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:04.166 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-07-06T13:18:04.316 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-07-06T13:18:04.404 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-07-06T13:18:04.563 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-07-06T13:18:04.605 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-07-06T13:18:04.782 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-07-06T13:18:04.798 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-openid (2.2.5-6) ... 2020-07-06T13:18:04.974 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-openid (2.2.5-6) ... 2020-07-06T13:18:05.024 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-07-06T13:18:05.201 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-07-06T13:18:05.217 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-07-06T13:18:05.369 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-07-06T13:18:05.411 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-07-06T13:18:05.570 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-07-06T13:18:05.603 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-chardet (3.0.4-1) ... 2020-07-06T13:18:05.763 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-chardet (3.0.4-1) ... 2020-07-06T13:18:05.880 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-07-06T13:18:06.006 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:18:06.032 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-07-06T13:18:06.158 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:18:06.240 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:06.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:06.541 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-07-06T13:18:06.651 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-07-06T13:18:06.669 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-07-06T13:18:06.760 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-07-06T13:18:06.795 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-07-06T13:18:06.904 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-07-06T13:18:06.928 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-07-06T13:18:07.054 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-07-06T13:18:07.097 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-07-06T13:18:07.180 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:18:07.232 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-07-06T13:18:07.358 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:18:07.398 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:07.524 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-waitress (1.0.1-1) ... 2020-07-06T13:18:07.576 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-ceph-argparse (13.2.10-1bionic) ... 2020-07-06T13:18:07.694 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-waitress (1.0.1-1) ... 2020-07-06T13:18:07.846 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-07-06T13:18:08.010 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-07-06T13:18:08.018 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-07-06T13:18:08.203 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:18:08.222 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-07-06T13:18:08.415 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:18:08.462 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-07-06T13:18:08.663 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-07-06T13:18:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-07-06T13:18:08.856 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-07-06T13:18:08.876 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-07-06T13:18:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-07-06T13:18:09.069 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-07-06T13:18:09.125 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-07-06T13:18:09.170 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-07-06T13:18:09.271 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-07-06T13:18:09.343 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-07-06T13:18:09.489 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-07-06T13:18:09.552 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-07-06T13:18:09.678 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:18:09.732 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-07-06T13:18:09.850 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:18:09.896 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-07-06T13:18:10.060 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-07-06T13:18:10.106 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0 (2.6.1-1) ... 2020-07-06T13:18:10.269 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liboath0 (2.6.1-1) ... 2020-07-06T13:18:10.282 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-07-06T13:18:10.421 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-07-06T13:18:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-07-06T13:18:10.605 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-07-06T13:18:10.609 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-tempita (0.5.2-2) ... 2020-07-06T13:18:10.731 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-tempita (0.5.2-2) ... 2020-07-06T13:18:10.794 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-07-06T13:18:10.895 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-webencodings (0.5-2) ... 2020-07-06T13:18:10.925 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-07-06T13:18:11.076 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-webencodings (0.5-2) ... 2020-07-06T13:18:11.096 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-07-06T13:18:11.269 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-07-06T13:18:11.347 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-07-06T13:18:11.512 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-07-06T13:18:11.540 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-logutils (0.3.3-5) ... 2020-07-06T13:18:11.696 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-logutils (0.3.3-5) ... 2020-07-06T13:18:11.733 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-routes (2.4.1-1) ... 2020-07-06T13:18:11.889 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-routes (2.4.1-1) ... 2020-07-06T13:18:11.934 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-07-06T13:18:12.091 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-07-06T13:18:12.160 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.5+dfsg-2) ... 2020-07-06T13:18:12.270 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:18:12.317 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up jq (1.5+dfsg-2) ... 2020-07-06T13:18:12.468 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:18:12.504 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:18:12.711 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:18:12.789 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-07-06T13:18:12.915 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-07-06T13:18:12.979 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-07-06T13:18:13.041 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (13.2.10-1bionic) ... 2020-07-06T13:18:13.089 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-07-06T13:18:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (13.2.10-1bionic) ... 2020-07-06T13:18:13.215 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (13.2.10-1bionic) ... 2020-07-06T13:18:13.293 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (13.2.10-1bionic) ... 2020-07-06T13:18:13.342 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (13.2.10-1bionic) ... 2020-07-06T13:18:13.403 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (13.2.10-1bionic) ... 2020-07-06T13:18:13.472 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (13.2.10-1bionic) ... 2020-07-06T13:18:13.503 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-07-06T13:18:13.593 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (13.2.10-1bionic) ... 2020-07-06T13:18:13.719 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-07-06T13:18:13.738 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-rados (13.2.10-1bionic) ... 2020-07-06T13:18:13.864 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:13.963 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-rados (13.2.10-1bionic) ... 2020-07-06T13:18:14.057 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (13.2.10-1bionic) ... 2020-07-06T13:18:14.089 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:14.183 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:14.298 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (13.2.10-1bionic) ... 2020-07-06T13:18:14.425 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (13.2.10-1bionic) ... 2020-07-06T13:18:14.485 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (13.2.10-1bionic) ... 2020-07-06T13:18:14.602 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-07-06T13:18:14.734 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (13.2.10-1bionic) ... 2020-07-06T13:18:14.855 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:14.914 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:14.953 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-07-06T13:18:15.129 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:15.130 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-07-06T13:18:15.131 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-07-06T13:18:15.333 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-07-06T13:18:15.334 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-07-06T13:18:15.422 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (13.2.10-1bionic) ... 2020-07-06T13:18:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-07-06T13:18:15.656 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (13.2.10-1bionic) ... 2020-07-06T13:18:15.766 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:15.782 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-07-06T13:18:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:16.000 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:16.018 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (13.2.10-1bionic) ... 2020-07-06T13:18:16.126 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (13.2.10-1bionic) ... 2020-07-06T13:18:16.244 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (13.2.10-1bionic) ... 2020-07-06T13:18:16.594 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2020-07-06T13:18:16.820 INFO:teuthology.orchestra.run.smithi118.stdout:Adding group ceph....done 2020-07-06T13:18:17.056 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2020-07-06T13:18:17.215 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2020-07-06T13:18:17.282 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user ceph....done 2020-07-06T13:18:17.367 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-07-06T13:18:17.441 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties....done 2020-07-06T13:18:17.602 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-07-06T13:18:17.602 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-07-06T13:18:17.812 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-07-06T13:18:17.888 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (13.2.10-1bionic) ... 2020-07-06T13:18:18.097 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (13.2.10-1bionic) ... 2020-07-06T13:18:18.265 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-07-06T13:18:18.265 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-07-06T13:18:18.511 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-07-06T13:18:18.511 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-07-06T13:18:18.657 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:18.783 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:18:18.876 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (13.2.10-1bionic) ... 2020-07-06T13:18:18.993 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (13.2.10-1bionic) ... 2020-07-06T13:18:19.002 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:18:19.119 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:19.203 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (13.2.10-1bionic) ... 2020-07-06T13:18:19.220 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (13.2.10-1bionic) ... 2020-07-06T13:18:19.304 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (13.2.10-1bionic) ... 2020-07-06T13:18:19.405 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (13.2.10-1bionic) ... 2020-07-06T13:18:19.629 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-07-06T13:18:19.845 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-07-06T13:18:19.897 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pecan (1.2.1-2) ... 2020-07-06T13:18:19.987 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-07-06T13:18:20.019 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-07-06T13:18:20.108 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pecan (1.2.1-2) ... 2020-07-06T13:18:20.198 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-07-06T13:18:20.200 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (13.2.10-1bionic) ... 2020-07-06T13:18:20.233 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-07-06T13:18:20.428 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (13.2.10-1bionic) ... 2020-07-06T13:18:20.687 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-07-06T13:18:20.825 INFO:teuthology.orchestra.run.smithi118.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-07-06T13:18:20.950 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-07-06T13:18:20.951 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-07-06T13:18:21.085 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-07-06T13:18:21.085 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-07-06T13:18:21.229 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (13.2.10-1bionic) ... 2020-07-06T13:18:21.373 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (13.2.10-1bionic) ... 2020-07-06T13:18:21.562 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-07-06T13:18:21.563 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-07-06T13:18:21.718 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-07-06T13:18:21.719 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-07-06T13:18:21.857 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (13.2.10-1bionic) ... 2020-07-06T13:18:22.018 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (13.2.10-1bionic) ... 2020-07-06T13:18:22.204 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-07-06T13:18:22.204 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-07-06T13:18:22.350 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-07-06T13:18:22.350 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-07-06T13:18:22.484 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (13.2.10-1bionic) ... 2020-07-06T13:18:22.604 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (13.2.10-1bionic) ... 2020-07-06T13:18:23.048 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-07-06T13:18:23.048 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-07-06T13:18:23.136 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-07-06T13:18:23.136 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-07-06T13:18:23.339 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (13.2.10-1bionic) ... 2020-07-06T13:18:23.401 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (13.2.10-1bionic) ... 2020-07-06T13:18:23.466 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for systemd (237-3ubuntu10.41) ... 2020-07-06T13:18:23.528 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for systemd (237-3ubuntu10.41) ... 2020-07-06T13:18:23.675 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-07-06T13:18:23.721 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-07-06T13:18:24.848 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-07-06T13:18:24.852 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-07-06T13:18:24.891 INFO:teuthology.orchestra.run.smithi118.stdout:ureadahead will be reprofiled on next reboot 2020-07-06T13:18:24.897 INFO:teuthology.orchestra.run.smithi148.stdout:ureadahead will be reprofiled on next reboot 2020-07-06T13:18:24.938 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-07-06T13:18:24.948 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-07-06T13:18:25.374 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-07-06T13:18:25.377 DEBUG:teuthology.parallel:result is None 2020-07-06T13:18:25.378 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-07-06T13:18:25.381 DEBUG:teuthology.parallel:result is None 2020-07-06T13:18:25.382 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:18:25.424 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:18:25.428 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:18:25.429 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-06T13:18:25.429 INFO:teuthology.packaging:ref: None 2020-07-06T13:18:25.430 INFO:teuthology.packaging:tag: None 2020-07-06T13:18:25.430 INFO:teuthology.packaging:branch: mimic 2020-07-06T13:18:25.431 INFO:teuthology.packaging:sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:18:25.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-07-06T13:18:25.700 INFO:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2020-07-06T13:18:25.723 INFO:teuthology.orchestra.run.smithi118.stdout:13.2.10-1bionic 2020-07-06T13:18:25.724 INFO:teuthology.packaging:The installed version of ceph is 13.2.10-1bionic 2020-07-06T13:18:25.725 INFO:teuthology.task.install:The correct ceph version 13.2.10-1bionic is installed. 2020-07-06T13:18:25.725 INFO:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2020-07-06T13:18:25.778 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2020-07-06T13:18:25.783 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:18:25.783 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-06T13:18:25.784 INFO:teuthology.packaging:ref: None 2020-07-06T13:18:25.784 INFO:teuthology.packaging:tag: None 2020-07-06T13:18:25.784 INFO:teuthology.packaging:branch: mimic 2020-07-06T13:18:25.785 INFO:teuthology.packaging:sha1: dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:18:25.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-07-06T13:18:26.065 INFO:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2020-07-06T13:18:26.089 INFO:teuthology.orchestra.run.smithi148.stdout:13.2.10-1bionic 2020-07-06T13:18:26.090 INFO:teuthology.packaging:The installed version of ceph is 13.2.10-1bionic 2020-07-06T13:18:26.090 INFO:teuthology.task.install:The correct ceph version 13.2.10-1bionic is installed. 2020-07-06T13:18:26.091 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-07-06T13:18:26.091 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-06T13:18:26.107 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-06T13:18:26.149 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-07-06T13:18:26.150 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-06T13:18:26.166 INFO:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-06T13:18:26.223 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-06T13:18:26.240 INFO:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-06T13:18:26.297 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-07-06T13:18:26.298 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-06T13:18:26.348 INFO:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-06T13:18:26.403 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-06T13:18:26.449 INFO:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-06T13:18:26.503 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:18:26.516 INFO:teuthology.task.print:**** done installing mimic 2020-07-06T13:18:26.516 INFO:teuthology.run_tasks:Running task ceph... 2020-07-06T13:18:26.594 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-07-06T13:18:26.595 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2020-07-06T13:18:26.598 INFO:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2020-07-06T13:18:26.613 INFO:tasks.ceph:Disabling ceph logrotate... 2020-07-06T13:18:26.613 INFO:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-06T13:18:26.656 INFO:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-06T13:18:26.671 INFO:tasks.ceph:Creating extra log directories... 2020-07-06T13:18:26.671 INFO:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-06T13:18:26.713 INFO:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-06T13:18:26.731 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-07-06T13:18:26.732 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': False} 2020-07-06T13:18:26.732 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi/5203029', 'branch': 'wip-fix-setxattr-client10', 'description': 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-verify.yaml} ubuntu_18.04.yaml}', 'email': None, 'first_in_suite': False, 'job_id': '5203029', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/mimic latest\n'}], 'name': 'sidharthanup-2020-07-06_12:48:12-fs-wip-fix-setxattr-client10-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'wip-fix-setxattr-client10'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'mon_bind_addrvec': False, 'mon_bind_msgr2': False, 'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '754758768dacbb43223ce6879371b1e2ab6a4c92'}}, 'owner': 'scheduled_sidharthanup@teuthology', 'priority': 105, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0', 'client.1']], 'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_octopus/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '754758768dacbb43223ce6879371b1e2ab6a4c92', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm'], 'extra_packages': ['librados2'], 'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'}}, {'print': '**** done installing mimic'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'mon_bind_addrvec': False, 'mon_bind_msgr2': False, 'fs': 'xfs', 'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd require-osd-release mimic', 'ceph osd set-require-min-compat-client mimic']}}, {'print': '**** done ceph'}, {'workunit': {'clients': {'client.0': ['fs/upgrade/volume_client']}, 'env': {'ACTION': 'create'}}}, {'print': '**** fs/volume_client create'}, {'ceph-fuse': {'client.0': {'auth_id': 'vol_data_isolated', 'mount_path': '/volumes/_nogroup/vol_isolated', 'mountpoint': 'mnt.0'}, 'client.1': {'auth_id': 'vol_default', 'mount_path': '/volumes/_nogroup/vol_default', 'mountpoint': 'mnt.1'}}}, {'print': '**** ceph-fuse vol_isolated'}, {'workunit': {'cleanup': False, 'clients': {'client.0': ['fs/upgrade/volume_client']}, 'env': {'ACTION': 'populate'}}}, {'workunit': {'cleanup': False, 'clients': {'client.1': ['fs/upgrade/volume_client']}, 'env': {'ACTION': 'populate'}}}, {'print': '**** fs/volume_client populate'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'exec': {'mon.a': ['ceph config set global mon_warn_on_msgr2_not_enabled false']}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph mon enable-msgr2', 'ceph versions', 'ceph osd dump -f json-pretty', 'ceph config rm global mon_warn_on_msgr2_not_enabled', 'ceph osd require-osd-release octopus', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs volume ls', 'ceph fs subvolume ls cephfs']}}, {'workunit': {'cleanup': False, 'clients': {'client.0': ['fs/upgrade/volume_client']}, 'env': {'ACTION': 'verify'}}}, {'workunit': {'cleanup': False, 'clients': {'client.1': ['fs/upgrade/volume_client']}, 'env': {'ACTION': 'verify'}}}, {'print': '**** fs/volume_client verify'}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.20770', 'targets': {'smithi118.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCuuNMfx60q5HPmA0HLt+CUwSRWWBShmYc/O6WqWciNvSr/Xyfl0/pTWo3FjMEM6WOBAqQeD88dyke8rxsQ7iqxoLU5QZIW2cVs3CAm40lmcZYQ5Yp90za2PaL7dUwFo8ZVBc+MK6i0AgbPDw+/x82yDhR7y2pmqJU8RMqqc/8GycR9mj9RofxmUuoBc+lxjaY0ORYWZfvlHEQS1WVIBB48hGFa2wxxeVhbt+JY6i6XvyaAodyCN1JruK/RAWJ0jf9vleeBHxMhsiGlzfYQTFuZ3DumRB77MJTjRLXZFGbknZlCwLE5QYL6CTLa/8N9E+EB4CrS0+wcSz+F0FopjZAn', 'smithi148.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyaOL/u5Ris9lw1L3iqOMVxnx5BV6286yHgnniVTmV9kWw7HqjPIJWL/lgm4YSOWB2juUH2rQCrCDycs+F74GwcPejx24oTInYlioBQuCGN4Ba2lZISZskpgJPN4IEujI4XQLpjEfN/PsBN9bbFakNHuDDGjaFoBNNEdnthkuV+eSSQSJ09eXNPOVc+8JXYRKstXhJN0jLvcgW4kPFzR6078WXBgzoPLtOFQ9qvC+j0sAc/dxkEbhf/+ad6bMwlgujouVUSgFRSjT2J5t/pzVh07gApO+6kDB9tYwkfEdQvzItHqOcpHL8Cy0d9KztOqfs3PpCkjGKQd2Yr9+JK5SL'}} 2020-07-06T13:18:26.738 INFO:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-06T13:18:26.775 INFO:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-06T13:18:26.782 INFO:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2020-07-06T13:18:26.823 INFO:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2020-07-06T13:18:26.885 DEBUG:teuthology.orchestra.remote:smithi118:/scratch_devs is 72B 2020-07-06T13:18:26.896 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-06T13:18:26.897 INFO:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-06T13:18:26.903 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-06T13:18:26.904 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-06T13:18:26.904 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 343 Links: 1 2020-07-06T13:18:26.904 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:18:26.904 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2020-07-06 13:16:55.311690425 +0000 2020-07-06T13:18:26.904 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2020-07-06 13:16:55.187690428 +0000 2020-07-06T13:18:26.905 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2020-07-06 13:16:55.187690428 +0000 2020-07-06T13:18:26.905 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2020-07-06T13:18:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2020-07-06T13:18:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2020-07-06T13:18:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000329525 s, 1.6 MB/s 2020-07-06T13:18:26.914 INFO:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-06T13:18:26.967 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-06T13:18:26.968 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-06T13:18:26.968 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 350 Links: 1 2020-07-06T13:18:26.968 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:18:26.968 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2020-07-06 13:16:55.567690419 +0000 2020-07-06T13:18:26.969 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2020-07-06 13:16:55.463690422 +0000 2020-07-06T13:18:26.969 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2020-07-06 13:16:55.463690422 +0000 2020-07-06T13:18:26.969 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2020-07-06T13:18:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2020-07-06T13:18:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2020-07-06T13:18:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000326767 s, 1.6 MB/s 2020-07-06T13:18:26.980 INFO:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-06T13:18:27.032 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-06T13:18:27.032 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-06T13:18:27.033 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 356 Links: 1 2020-07-06T13:18:27.033 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:18:27.033 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2020-07-06 13:16:55.827690414 +0000 2020-07-06T13:18:27.033 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2020-07-06 13:16:55.695690417 +0000 2020-07-06T13:18:27.033 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2020-07-06 13:16:55.695690417 +0000 2020-07-06T13:18:27.034 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2020-07-06T13:18:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2020-07-06T13:18:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2020-07-06T13:18:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000383491 s, 1.3 MB/s 2020-07-06T13:18:27.045 INFO:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-06T13:18:27.092 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-06T13:18:27.092 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-06T13:18:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 362 Links: 1 2020-07-06T13:18:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:18:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2020-07-06 13:16:56.123690407 +0000 2020-07-06T13:18:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2020-07-06 13:16:55.999690410 +0000 2020-07-06T13:18:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2020-07-06 13:16:55.999690410 +0000 2020-07-06T13:18:27.094 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2020-07-06T13:18:27.100 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2020-07-06T13:18:27.100 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2020-07-06T13:18:27.101 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000396237 s, 1.3 MB/s 2020-07-06T13:18:27.105 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-06T13:18:27.105 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2020-07-06T13:18:27.106 INFO:tasks.ceph:Generating config... 2020-07-06T13:18:27.107 INFO:tasks.ceph:[global] mon warn on pool no app = False 2020-07-06T13:18:27.108 INFO:tasks.ceph:[global] ms bind msgr2 = False 2020-07-06T13:18:27.108 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2020-07-06T13:18:27.108 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2020-07-06T13:18:27.109 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2020-07-06T13:18:27.109 INFO:tasks.ceph:[client] client mount timeout = 600 2020-07-06T13:18:27.109 INFO:tasks.ceph:[client] debug client = 20 2020-07-06T13:18:27.110 INFO:tasks.ceph:[client] debug ms = 1 2020-07-06T13:18:27.110 INFO:tasks.ceph:[mds] debug mds = 20 2020-07-06T13:18:27.111 INFO:tasks.ceph:[mds] debug ms = 1 2020-07-06T13:18:27.111 INFO:tasks.ceph:[mds] mds bal frag = True 2020-07-06T13:18:27.111 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-07-06T13:18:27.112 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-07-06T13:18:27.112 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-07-06T13:18:27.112 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-07-06T13:18:27.113 INFO:tasks.ceph:[mds] mds debug frag = True 2020-07-06T13:18:27.113 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-07-06T13:18:27.113 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-07-06T13:18:27.114 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-07-06T13:18:27.115 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-07-06T13:18:27.115 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-07-06T13:18:27.115 INFO:tasks.ceph:[mgr] debug ms = 1 2020-07-06T13:18:27.116 INFO:tasks.ceph:[mon] debug mon = 20 2020-07-06T13:18:27.116 INFO:tasks.ceph:[mon] debug ms = 1 2020-07-06T13:18:27.116 INFO:tasks.ceph:[mon] debug paxos = 20 2020-07-06T13:18:27.117 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-07-06T13:18:27.118 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2020-07-06T13:18:27.119 INFO:tasks.ceph:[osd] bdev async discard = True 2020-07-06T13:18:27.119 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-07-06T13:18:27.119 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-07-06T13:18:27.120 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-07-06T13:18:27.120 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-07-06T13:18:27.120 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-07-06T13:18:27.121 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-07-06T13:18:27.121 INFO:tasks.ceph:[osd] debug filestore = 20 2020-07-06T13:18:27.122 INFO:tasks.ceph:[osd] debug journal = 20 2020-07-06T13:18:27.122 INFO:tasks.ceph:[osd] debug ms = 20 2020-07-06T13:18:27.122 INFO:tasks.ceph:[osd] debug osd = 25 2020-07-06T13:18:27.123 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-07-06T13:18:27.123 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-07-06T13:18:27.123 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-07-06T13:18:27.123 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-07-06T13:18:27.124 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-07-06T13:18:27.125 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-07-06T13:18:27.126 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-07-06T13:18:27.126 INFO:tasks.ceph:Setting up mon.a... 2020-07-06T13:18:27.126 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-07-06T13:18:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2020-07-06T13:18:27.201 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-07-06T13:18:27.233 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-06T13:18:27.287 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118:6789'), ('mon.b', '172.21.15.118:6790'), ('mon.c', '172.21.15.118:6791')] 2020-07-06T13:18:27.287 INFO:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --add a 172.21.15.118:6789 --add b 172.21.15.118:6790 --add c 172.21.15.118:6791 --print /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid 74e2240b-47f9-4a3f-ade9-f9f65278ae84 2020-07-06T13:18:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2020-07-06T13:18:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsid 74e2240b-47f9-4a3f-ade9-f9f65278ae84 2020-07-06T13:18:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2020-07-06 13:18:27.360561 2020-07-06T13:18:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:created 2020-07-06 13:18:27.360561 2020-07-06T13:18:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:0: 172.21.15.118:6789/0 mon.a 2020-07-06T13:18:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:1: 172.21.15.118:6790/0 mon.b 2020-07-06T13:18:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:2: 172.21.15.118:6791/0 mon.c 2020-07-06T13:18:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-07-06T13:18:27.362 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 74e2240b-47f9-4a3f-ade9-f9f65278ae84... 2020-07-06T13:18:27.363 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-06T13:18:27.403 INFO:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-06T13:18:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2020-07-06T13:18:27.434 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2020-07-06T13:18:27.434 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-06T13:18:27.435 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2020-07-06T13:18:27.435 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.435 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2020-07-06T13:18:27.435 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.435 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2020-07-06T13:18:27.436 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.436 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2020-07-06T13:18:27.436 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2020-07-06T13:18:27.436 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.436 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2020-07-06T13:18:27.437 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2020-07-06T13:18:27.437 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.437 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-06T13:18:27.437 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2020-07-06T13:18:27.437 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.438 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2020-07-06T13:18:27.439 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2020-07-06T13:18:27.439 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2020-07-06T13:18:27.439 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2020-07-06T13:18:27.439 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2020-07-06T13:18:27.439 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2020-07-06T13:18:27.440 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2020-07-06T13:18:27.440 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-06T13:18:27.440 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-06T13:18:27.440 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.440 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.441 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2020-07-06T13:18:27.442 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2020-07-06T13:18:27.442 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118:6789,172.21.15.118:6790,172.21.15.118:6791" 2020-07-06T13:18:27.442 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on pool no app = False 2020-07-06T13:18:27.442 INFO:teuthology.orchestra.run.smithi118.stdout: ms bind msgr2 = False 2020-07-06T13:18:27.442 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore warn on legacy statfs = False 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore warn on no per pool omap = False 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn min per osd = 0 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 74e2240b-47f9-4a3f-ade9-f9f65278ae84 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2020-07-06T13:18:27.443 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2020-07-06T13:18:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2020-07-06T13:18:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2020-07-06T13:18:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2020-07-06T13:18:27.445 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.447 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2020-07-06T13:18:27.447 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2020-07-06T13:18:27.447 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.447 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2020-07-06T13:18:27.448 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.448 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2020-07-06T13:18:27.448 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.448 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2020-07-06T13:18:27.448 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.449 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2020-07-06T13:18:27.449 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2020-07-06T13:18:27.449 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.449 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2020-07-06T13:18:27.449 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2020-07-06T13:18:27.450 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2020-07-06T13:18:27.451 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2020-07-06T13:18:27.451 INFO:teuthology.orchestra.run.smithi118.stdout: debug filestore = 20 2020-07-06T13:18:27.451 INFO:teuthology.orchestra.run.smithi118.stdout: debug journal = 20 2020-07-06T13:18:27.451 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 20 2020-07-06T13:18:27.451 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 25 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2020-07-06T13:18:27.452 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2020-07-06T13:18:27.453 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2020-07-06T13:18:27.453 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2020-07-06T13:18:27.453 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2020-07-06T13:18:27.453 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2020-07-06T13:18:27.454 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2020-07-06T13:18:27.454 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2020-07-06T13:18:27.454 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2020-07-06T13:18:27.454 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2020-07-06T13:18:27.454 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2020-07-06T13:18:27.455 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2020-07-06T13:18:27.455 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2020-07-06T13:18:27.456 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2020-07-06T13:18:27.456 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2020-07-06T13:18:27.456 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2020-07-06T13:18:27.457 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2020-07-06T13:18:27.457 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2020-07-06T13:18:27.457 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2020-07-06T13:18:27.457 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2020-07-06T13:18:27.458 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2020-07-06T13:18:27.458 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2020-07-06T13:18:27.458 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2020-07-06T13:18:27.458 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = False 2020-07-06T13:18:27.458 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-06T13:18:27.459 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-06T13:18:27.460 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2020-07-06T13:18:27.460 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2020-07-06T13:18:27.460 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2020-07-06T13:18:27.460 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2020-07-06T13:18:27.460 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2020-07-06T13:18:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2020-07-06T13:18:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2020-07-06T13:18:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2020-07-06T13:18:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2020-07-06T13:18:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2020-07-06T13:18:27.462 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2020-07-06T13:18:27.462 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2020-07-06T13:18:27.462 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal frag = True 2020-07-06T13:18:27.462 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal fragment size max = 10000 2020-07-06T13:18:27.462 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal merge size = 5 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal split bits = 3 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal split size = 100 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2020-07-06T13:18:27.463 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2020-07-06T13:18:27.464 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2020-07-06T13:18:27.465 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2020-07-06T13:18:27.465 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2020-07-06T13:18:27.466 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-06T13:18:27.466 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2020-07-06T13:18:27.466 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.466 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2020-07-06T13:18:27.467 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.467 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2020-07-06T13:18:27.467 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.468 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2020-07-06T13:18:27.468 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2020-07-06T13:18:27.469 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.470 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2020-07-06T13:18:27.470 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2020-07-06T13:18:27.470 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.471 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-06T13:18:27.471 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2020-07-06T13:18:27.471 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.471 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2020-07-06T13:18:27.471 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-06T13:18:27.472 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.472 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2020-07-06T13:18:27.472 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.472 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2020-07-06T13:18:27.472 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2020-07-06T13:18:27.473 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-06T13:18:27.474 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-06T13:18:27.474 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.474 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-06T13:18:27.474 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.474 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2020-07-06T13:18:27.475 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.118:6789,172.21.15.118:6790,172.21.15.118:6791" 2020-07-06T13:18:27.476 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on pool no app = False 2020-07-06T13:18:27.476 INFO:teuthology.orchestra.run.smithi148.stdout: ms bind msgr2 = False 2020-07-06T13:18:27.476 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore warn on legacy statfs = False 2020-07-06T13:18:27.476 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore warn on no per pool omap = False 2020-07-06T13:18:27.476 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn min per osd = 0 2020-07-06T13:18:27.477 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 74e2240b-47f9-4a3f-ade9-f9f65278ae84 2020-07-06T13:18:27.477 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.477 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2020-07-06T13:18:27.477 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2020-07-06T13:18:27.477 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2020-07-06T13:18:27.478 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2020-07-06T13:18:27.479 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2020-07-06T13:18:27.480 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.480 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2020-07-06T13:18:27.480 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.480 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2020-07-06T13:18:27.480 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.481 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2020-07-06T13:18:27.482 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2020-07-06T13:18:27.482 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2020-07-06T13:18:27.482 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2020-07-06T13:18:27.482 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2020-07-06T13:18:27.482 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2020-07-06T13:18:27.483 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2020-07-06T13:18:27.483 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2020-07-06T13:18:27.483 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2020-07-06T13:18:27.484 INFO:teuthology.orchestra.run.smithi148.stdout: debug filestore = 20 2020-07-06T13:18:27.484 INFO:teuthology.orchestra.run.smithi148.stdout: debug journal = 20 2020-07-06T13:18:27.484 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 20 2020-07-06T13:18:27.485 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 25 2020-07-06T13:18:27.485 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2020-07-06T13:18:27.485 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2020-07-06T13:18:27.485 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2020-07-06T13:18:27.485 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2020-07-06T13:18:27.486 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2020-07-06T13:18:27.487 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2020-07-06T13:18:27.487 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2020-07-06T13:18:27.487 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2020-07-06T13:18:27.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2020-07-06T13:18:27.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2020-07-06T13:18:27.488 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2020-07-06T13:18:27.488 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.488 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2020-07-06T13:18:27.488 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2020-07-06T13:18:27.488 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2020-07-06T13:18:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2020-07-06T13:18:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2020-07-06T13:18:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2020-07-06T13:18:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2020-07-06T13:18:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = False 2020-07-06T13:18:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-06T13:18:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-06T13:18:27.492 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2020-07-06T13:18:27.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2020-07-06T13:18:27.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2020-07-06T13:18:27.492 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2020-07-06T13:18:27.492 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2020-07-06T13:18:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2020-07-06T13:18:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2020-07-06T13:18:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2020-07-06T13:18:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2020-07-06T13:18:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal frag = True 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal fragment size max = 10000 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal merge size = 5 2020-07-06T13:18:27.494 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal split bits = 3 2020-07-06T13:18:27.495 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal split size = 100 2020-07-06T13:18:27.495 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2020-07-06T13:18:27.495 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2020-07-06T13:18:27.495 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2020-07-06T13:18:27.495 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2020-07-06T13:18:27.496 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2020-07-06T13:18:27.496 INFO:tasks.ceph:Creating admin key on mon.a... 2020-07-06T13:18:27.497 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-07-06T13:18:27.551 INFO:tasks.ceph:Copying monmap to all nodes... 2020-07-06T13:18:27.603 DEBUG:teuthology.orchestra.remote:smithi118:/etc/ceph/ceph.keyring is 206B 2020-07-06T13:18:27.622 DEBUG:teuthology.orchestra.remote:smithi118:/home/ubuntu/cephtest/ceph.monmap is 357B 2020-07-06T13:18:27.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:18:27.632 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-06T13:18:27.689 INFO:teuthology.orchestra.run.smithi118:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:27.775 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2020-07-06T13:18:27.775 INFO:teuthology.orchestra.run.smithi148:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-06T13:18:27.839 INFO:teuthology.orchestra.run.smithi148:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:27.925 INFO:tasks.ceph:Setting up mon nodes... 2020-07-06T13:18:27.925 INFO:tasks.ceph:Setting up mgr nodes... 2020-07-06T13:18:27.926 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-07-06T13:18:27.967 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-07-06T13:18:27.970 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-07-06T13:18:28.050 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-07-06T13:18:28.052 INFO:tasks.ceph:Setting up mds nodes... 2020-07-06T13:18:28.053 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-07-06T13:18:28.132 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-07-06T13:18:28.134 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-07-06T13:18:28.192 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-07-06T13:18:28.274 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-07-06T13:18:28.276 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-07-06T13:18:28.332 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-07-06T13:18:28.418 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-07-06T13:18:28.420 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-07-06T13:18:28.476 INFO:tasks.ceph_client:Setting up client nodes... 2020-07-06T13:18:28.477 INFO:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-07-06T13:18:28.531 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-07-06T13:18:28.543 INFO:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-07-06T13:18:28.574 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-07-06T13:18:28.586 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-07-06T13:18:28.586 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2020-07-06T13:18:28.587 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-07-06T13:18:28.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-06T13:18:28.602 INFO:tasks.ceph:role: osd.0 2020-07-06T13:18:28.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:18:28.603 INFO:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-07-06T13:18:29.137 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-07-06T13:18:29.137 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-06T13:18:29.138 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-07-06T13:18:29.138 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-06T13:18:29.138 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2020-07-06T13:18:29.138 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-07-06T13:18:29.138 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-06T13:18:29.139 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-06T13:18:29.139 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-06T13:18:29.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2020-07-06T13:18:29.140 INFO:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-07-06T13:18:29.219 INFO:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-07-06T13:18:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2020-07-06T13:18:29.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T13:18:29.231 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-07-06T13:18:29.285 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-06T13:18:29.285 INFO:tasks.ceph:role: osd.1 2020-07-06T13:18:29.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:18:29.286 INFO:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-07-06T13:18:29.803 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-07-06T13:18:29.804 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-06T13:18:29.804 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-07-06T13:18:29.804 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-06T13:18:29.805 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2020-07-06T13:18:29.805 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-07-06T13:18:29.805 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-06T13:18:29.805 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-06T13:18:29.805 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-06T13:18:29.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2020-07-06T13:18:29.807 INFO:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-07-06T13:18:29.864 INFO:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-07-06T13:18:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2020-07-06T13:18:29.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T13:18:29.875 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-07-06T13:18:29.932 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-06T13:18:29.932 INFO:tasks.ceph:role: osd.2 2020-07-06T13:18:29.932 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:18:29.933 INFO:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-07-06T13:18:30.451 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-07-06T13:18:30.452 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-06T13:18:30.452 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-07-06T13:18:30.452 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-06T13:18:30.452 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2020-07-06T13:18:30.452 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-07-06T13:18:30.453 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-06T13:18:30.453 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-06T13:18:30.453 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-06T13:18:30.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2020-07-06T13:18:30.454 INFO:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-07-06T13:18:30.494 INFO:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-07-06T13:18:30.548 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2020-07-06T13:18:30.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T13:18:30.549 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-07-06T13:18:30.604 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-06T13:18:30.604 INFO:tasks.ceph:role: osd.3 2020-07-06T13:18:30.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:18:30.605 INFO:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-07-06T13:18:31.129 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-07-06T13:18:31.130 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-06T13:18:31.130 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-07-06T13:18:31.130 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-06T13:18:31.130 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2020-07-06T13:18:31.131 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-07-06T13:18:31.131 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-06T13:18:31.131 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-06T13:18:31.131 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-06T13:18:31.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2020-07-06T13:18:31.132 INFO:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-07-06T13:18:31.170 INFO:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-07-06T13:18:31.224 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2020-07-06T13:18:31.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T13:18:31.226 INFO:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:31.322 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.323 7fefd095cc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-07-06T13:18:31.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.323 7fefd095cc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-07-06T13:18:31.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.323 7fefd095cc00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-06T13:18:31.324 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.323 7fefd095cc00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-06T13:18:31.324 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.323 7fefd095cc00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-06T13:18:31.330 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:31.331 7fefd095cc00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-07-06T13:18:33.485 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-07-06T13:18:33.501 INFO:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:33.587 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-07-06T13:18:33.588 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-07-06T13:18:33.588 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-06T13:18:33.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-06T13:18:33.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-06T13:18:33.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:33.587 7fe65e2fbc00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-07-06T13:18:35.756 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-07-06T13:18:35.817 INFO:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:35.899 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-07-06T13:18:35.900 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-07-06T13:18:35.900 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-06T13:18:35.900 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-06T13:18:35.900 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-06T13:18:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:35.899 7faa89b2ac00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-07-06T13:18:38.080 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-07-06T13:18:38.137 INFO:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:38.220 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.219 7fe2db841c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-07-06T13:18:38.221 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.219 7fe2db841c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-07-06T13:18:38.221 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.219 7fe2db841c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-06T13:18:38.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.219 7fe2db841c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-06T13:18:38.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.219 7fe2db841c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-06T13:18:38.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:38.223 7fe2db841c00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-07-06T13:18:40.412 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-07-06T13:18:40.468 INFO:tasks.ceph:Reading keys from all nodes... 2020-07-06T13:18:40.469 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:40.514 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.eRRMTrbxVf 2020-07-06T13:18:40.515 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.eRRMTrbxVf 2020-07-06T13:18:40.572 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.eRRMTrbxVf 2020-07-06T13:18:40.682 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.eRRMTrbxVf is 56B 2020-07-06T13:18:40.693 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.eRRMTrbxVf 2020-07-06T13:18:40.699 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:40.748 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.hY2Bo6xrqH 2020-07-06T13:18:40.748 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.hY2Bo6xrqH 2020-07-06T13:18:40.803 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.hY2Bo6xrqH 2020-07-06T13:18:40.912 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.hY2Bo6xrqH is 56B 2020-07-06T13:18:40.923 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.hY2Bo6xrqH 2020-07-06T13:18:40.929 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:40.974 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.WNNZS677it 2020-07-06T13:18:40.975 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.WNNZS677it 2020-07-06T13:18:41.032 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.WNNZS677it 2020-07-06T13:18:41.140 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.WNNZS677it is 56B 2020-07-06T13:18:41.151 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.WNNZS677it 2020-07-06T13:18:41.156 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.WTWjLO1JgS 2020-07-06T13:18:41.203 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.WTWjLO1JgS 2020-07-06T13:18:41.259 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.WTWjLO1JgS 2020-07-06T13:18:41.368 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.WTWjLO1JgS is 56B 2020-07-06T13:18:41.378 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.WTWjLO1JgS 2020-07-06T13:18:41.384 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:41.431 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.3i0bV67urz 2020-07-06T13:18:41.432 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.3i0bV67urz 2020-07-06T13:18:41.493 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.3i0bV67urz 2020-07-06T13:18:41.597 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.3i0bV67urz is 56B 2020-07-06T13:18:41.607 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.3i0bV67urz 2020-07-06T13:18:41.613 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:41.658 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.QzI5AhGzUG 2020-07-06T13:18:41.659 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.QzI5AhGzUG 2020-07-06T13:18:41.715 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.QzI5AhGzUG 2020-07-06T13:18:41.820 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.QzI5AhGzUG is 56B 2020-07-06T13:18:41.830 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.QzI5AhGzUG 2020-07-06T13:18:41.837 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:41.882 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.qr4ayRZUQf 2020-07-06T13:18:41.882 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.qr4ayRZUQf 2020-07-06T13:18:41.940 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.qr4ayRZUQf 2020-07-06T13:18:42.044 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.qr4ayRZUQf is 56B 2020-07-06T13:18:42.055 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.qr4ayRZUQf 2020-07-06T13:18:42.061 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:42.110 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.PdwdaU8iDJ 2020-07-06T13:18:42.110 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.PdwdaU8iDJ 2020-07-06T13:18:42.167 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.PdwdaU8iDJ 2020-07-06T13:18:42.272 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.PdwdaU8iDJ is 56B 2020-07-06T13:18:42.282 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.PdwdaU8iDJ 2020-07-06T13:18:42.288 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:42.334 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.AUrUMjyPZy 2020-07-06T13:18:42.335 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.AUrUMjyPZy 2020-07-06T13:18:42.391 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.AUrUMjyPZy 2020-07-06T13:18:42.497 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.AUrUMjyPZy is 56B 2020-07-06T13:18:42.507 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.AUrUMjyPZy 2020-07-06T13:18:42.521 DEBUG:teuthology.orchestra.remote:smithi148:/etc/ceph/ceph.client.0.keyring is 59B 2020-07-06T13:18:42.538 DEBUG:teuthology.orchestra.remote:smithi148:/etc/ceph/ceph.client.1.keyring is 59B 2020-07-06T13:18:42.548 INFO:tasks.ceph:Adding keys to all mons... 2020-07-06T13:18:42.549 INFO:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2020-07-06T13:18:42.565 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2020-07-06T13:18:42.566 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCjJANfD+zVORAA0CAfy7CCMuyD1pWwPk9OKQ== 2020-07-06T13:18:42.566 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2020-07-06T13:18:42.566 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANfkssjAxAAnasmSM4CmKbiPtI1gK9YpQ== 2020-07-06T13:18:42.566 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2020-07-06T13:18:42.566 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANfiIAKCBAA12rdiTfbXjc/1piStBI+Cw== 2020-07-06T13:18:42.567 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2020-07-06T13:18:42.567 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANfrrN4EBAALqrLelWL7DCGWRdTkVHYOA== 2020-07-06T13:18:42.567 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2020-07-06T13:18:42.567 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANfDb0MGRAAc7OV8lNqfz2Dbb+TFFzQ+g== 2020-07-06T13:18:42.567 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCnJANfkx1dExAAywda8Hjc40HPLCJwfC/ajA== 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCpJANfDkomIxAAQwx2EqPW9N1udEWcSTgtTA== 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCrJANflO/ENRAAduJ+gVD0Ci15GpdgDSyA2g== 2020-07-06T13:18:42.568 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2020-07-06T13:18:42.569 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCuJANfiMxJDRAAnZ0nRMFAwLSqH3V0VMoI/A== 2020-07-06T13:18:42.569 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2020-07-06T13:18:42.569 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANfL6rLHxAAXmQut12TR8REF4ljeh6VGQ== 2020-07-06T13:18:42.569 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2020-07-06T13:18:42.569 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCkJANftAxZIhAAVSpotQcjCMIBSuU/MSlqRw== 2020-07-06T13:18:42.570 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-06T13:18:42.652 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-06T13:18:42.735 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-06T13:18:42.821 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-06T13:18:42.902 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-06T13:18:42.986 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-06T13:18:43.069 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-06T13:18:43.148 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-06T13:18:43.229 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-06T13:18:43.312 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-06T13:18:43.394 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-06T13:18:43.478 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-07-06T13:18:43.479 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-07-06T13:18:43.535 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-06T13:18:43.633 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-07-06T13:18:43.646 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-07-06T13:18:43.703 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-06T13:18:43.802 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-07-06T13:18:43.815 INFO:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-07-06T13:18:43.871 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-06T13:18:43.971 INFO:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-07-06T13:18:43.985 INFO:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-07-06T13:18:44.034 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-07-06T13:18:44.035 INFO:tasks.ceph.mon.a:Restarting daemon 2020-07-06T13:18:44.036 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-07-06T13:18:44.079 INFO:tasks.ceph.mon.a:Started 2020-07-06T13:18:44.079 INFO:tasks.ceph.mon.b:Restarting daemon 2020-07-06T13:18:44.080 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-07-06T13:18:44.082 INFO:tasks.ceph.mon.b:Started 2020-07-06T13:18:44.082 INFO:tasks.ceph.mon.c:Restarting daemon 2020-07-06T13:18:44.083 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-07-06T13:18:44.085 INFO:tasks.ceph.mon.c:Started 2020-07-06T13:18:44.086 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-07-06T13:18:44.086 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-07-06T13:18:44.086 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-07-06T13:18:44.089 INFO:tasks.ceph.mgr.x:Started 2020-07-06T13:18:44.089 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-07-06T13:18:44.089 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-07-06T13:18:44.092 INFO:tasks.ceph.mgr.y:Started 2020-07-06T13:18:44.092 INFO:tasks.ceph:Setting crush tunables to default 2020-07-06T13:18:44.092 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2020-07-06T13:18:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.223 7f2558934700 1 Processor -- start 2020-07-06T13:18:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.223 7f2558934700 1 -- - start start 2020-07-06T13:18:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.223 7f2558934700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255414ba40 con 0 2020-07-06T13:18:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.223 7f2558934700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255414bde0 con 0 2020-07-06T13:18:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.223 7f2552826700 1 -- 172.21.15.118:0/3678020132 learned_addr learned my addr 172.21.15.118:0/3678020132 2020-07-06T13:18:44.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.395 7f2551824700 1 -- 172.21.15.118:0/3678020132 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f253c0022a0 con 0x7f255414b300 2020-07-06T13:18:44.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.395 7f2551824700 1 -- 172.21.15.118:0/3678020132 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2348048776 0 0) 0x7f253c002620 con 0x7f255414b300 2020-07-06T13:18:44.397 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.395 7f2551824700 1 -- 172.21.15.118:0/3678020132 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2534002a20 con 0 2020-07-06T13:18:44.398 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2551824700 1 -- 172.21.15.118:0/3678020132 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1849917909 0 0) 0x7f253c002b20 con 0x7f255414b300 2020-07-06T13:18:44.398 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2551824700 1 -- 172.21.15.118:0/3678020132 >> 172.21.15.118:6790/0 conn(0x7f2554148000 :-1 s=STATE_OPEN pgs=5 cs=1 l=1).mark_down 2020-07-06T13:18:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2551824700 1 -- 172.21.15.118:0/3678020132 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255407a860 con 0 2020-07-06T13:18:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2551824700 1 -- 172.21.15.118:0/3678020132 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2554116db0 con 0x7f255414b300 2020-07-06T13:18:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2551824700 1 -- 172.21.15.118:0/3678020132 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f253c001010 con 0x7f255414b300 2020-07-06T13:18:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2558934700 1 -- 172.21.15.118:0/3678020132 >> 172.21.15.118:6789/0 conn(0x7f255414b300 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-07-06T13:18:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2558934700 1 -- 172.21.15.118:0/3678020132 shutdown_connections 2020-07-06T13:18:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2558934700 1 -- 172.21.15.118:0/3678020132 shutdown_connections 2020-07-06T13:18:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2558934700 1 -- 172.21.15.118:0/3678020132 wait complete. 2020-07-06T13:18:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.399 7f2558934700 1 -- 172.21.15.118:0/3678020132 >> 172.21.15.118:0/3678020132 conn(0x7f2554143f30 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:44.402 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f2558934700 1 Processor -- start 2020-07-06T13:18:44.403 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f2558934700 1 -- - start start 2020-07-06T13:18:44.403 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f2558934700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540a3db0 con 0 2020-07-06T13:18:44.404 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f2558934700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2554095d40 con 0 2020-07-06T13:18:44.404 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f2552826700 1 -- 172.21.15.118:0/3463596219 learned_addr learned my addr 172.21.15.118:0/3463596219 2020-07-06T13:18:44.405 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f253c000e50 con 0x7f25540a5170 2020-07-06T13:18:44.405 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1948627619 0 0) 0x7f253c002050 con 0x7f25540a5170 2020-07-06T13:18:44.405 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2538002960 con 0 2020-07-06T13:18:44.405 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f25440036f0 con 0x7f25540a33c0 2020-07-06T13:18:44.406 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3158967917 0 0) 0x7f25440039f0 con 0x7f25540a33c0 2020-07-06T13:18:44.406 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.403 7f254bfff700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2538004620 con 0 2020-07-06T13:18:44.407 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2272787942 0 0) 0x7f253c0024a0 con 0x7f25540a5170 2020-07-06T13:18:44.407 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2538002ee0 con 0 2020-07-06T13:18:44.407 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1951213314 0 0) 0x7f2544003d80 con 0x7f25540a33c0 2020-07-06T13:18:44.407 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2538003540 con 0 2020-07-06T13:18:44.408 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2462427077 0 0) 0x7f25440010f0 con 0x7f25540a33c0 2020-07-06T13:18:44.408 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 >> 172.21.15.118:6790/0 conn(0x7f25540a5170 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-07-06T13:18:44.409 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255407aac0 con 0 2020-07-06T13:18:44.409 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f2558934700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554071640 con 0 2020-07-06T13:18:44.409 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f2558934700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540a6bb0 con 0 2020-07-06T13:18:44.409 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2544000bf0 con 0x7f25540a33c0 2020-07-06T13:18:44.410 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2544001520 con 0x7f25540a33c0 2020-07-06T13:18:44.410 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 1) v1 ==== 142+0+0 (1513742652 0 0) 0x7f2544001840 con 0x7f25540a33c0 2020-07-06T13:18:44.411 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.407 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 718+0+0 (991362527 0 0) 0x7f2544004580 con 0x7f25540a33c0 2020-07-06T13:18:44.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.435 7f2558934700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255407ae60 con 0 2020-07-06T13:18:44.440 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.439 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f255407ae60 con 0x7f25540a33c0 2020-07-06T13:18:44.539 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.539 7f2558934700 1 -- 172.21.15.118:0/3463596219 --> 172.21.15.118:6791/0 -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f25540731b0 con 0 2020-07-06T13:18:44.542 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.543 7f254bfff700 1 -- 172.21.15.118:0/3463596219 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (2119647551 0 0) 0x7f2544004a30 con 0x7f25540a33c0 2020-07-06T13:18:44.546 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2020-07-06T13:18:44.547 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.547 7f2558934700 1 -- 172.21.15.118:0/3463596219 >> 172.21.15.118:6791/0 conn(0x7f25540a33c0 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-07-06T13:18:44.548 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.547 7f2558934700 1 -- 172.21.15.118:0/3463596219 shutdown_connections 2020-07-06T13:18:44.548 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.547 7f2558934700 1 -- 172.21.15.118:0/3463596219 shutdown_connections 2020-07-06T13:18:44.548 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.547 7f2558934700 1 -- 172.21.15.118:0/3463596219 wait complete. 2020-07-06T13:18:44.548 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:44.547 7f2558934700 1 -- 172.21.15.118:0/3463596219 >> 172.21.15.118:0/3463596219 conn(0x7f2554145240 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:44.559 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-07-06T13:18:44.560 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:44.567 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.B9qkNaRNbY 2020-07-06T13:18:44.568 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.B9qkNaRNbY 2020-07-06T13:18:44.624 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.B9qkNaRNbY 2020-07-06T13:18:44.735 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.B9qkNaRNbY is 37B 2020-07-06T13:18:44.750 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.B9qkNaRNbY 2020-07-06T13:18:44.757 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:44.811 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.icoy78Nc31 2020-07-06T13:18:44.811 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.icoy78Nc31 2020-07-06T13:18:44.868 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.icoy78Nc31 2020-07-06T13:18:44.981 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.icoy78Nc31 is 37B 2020-07-06T13:18:44.992 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.icoy78Nc31 2020-07-06T13:18:44.998 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:45.049 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.fKwse30L25 2020-07-06T13:18:45.049 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.fKwse30L25 2020-07-06T13:18:45.102 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.fKwse30L25 2020-07-06T13:18:45.212 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.fKwse30L25 is 37B 2020-07-06T13:18:45.224 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.fKwse30L25 2020-07-06T13:18:45.230 INFO:teuthology.orchestra.run.smithi118:> mktemp 2020-07-06T13:18:45.278 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.R7LePj3zrB 2020-07-06T13:18:45.279 INFO:teuthology.orchestra.run.smithi118:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.R7LePj3zrB 2020-07-06T13:18:45.333 INFO:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.R7LePj3zrB 2020-07-06T13:18:45.436 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.R7LePj3zrB is 37B 2020-07-06T13:18:45.446 INFO:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.R7LePj3zrB 2020-07-06T13:18:45.452 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new c6be8af8-e07a-4192-8f17-7763c852c626 0 2020-07-06T13:18:45.586 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 Processor -- start 2020-07-06T13:18:45.586 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- - start start 2020-07-06T13:18:45.588 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee014ba40 con 0 2020-07-06T13:18:45.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee014bde0 con 0 2020-07-06T13:18:45.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efede826700 1 -- 172.21.15.118:0/4081687638 learned_addr learned my addr 172.21.15.118:0/4081687638 2020-07-06T13:18:45.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed40022a0 con 0x7efee014b300 2020-07-06T13:18:45.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed00039b0 con 0x7efee0148000 2020-07-06T13:18:45.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1561717337 0 0) 0x7efed4002620 con 0x7efee014b300 2020-07-06T13:18:45.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efec4002ea0 con 0 2020-07-06T13:18:45.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (690023474 0 0) 0x7efed0003d30 con 0x7efee0148000 2020-07-06T13:18:45.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efec40046b0 con 0 2020-07-06T13:18:45.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2535580620 0 0) 0x7efed00041d0 con 0x7efee0148000 2020-07-06T13:18:45.591 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 >> 172.21.15.118:6791/0 conn(0x7efee014b300 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-07-06T13:18:45.591 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee007a860 con 0 2020-07-06T13:18:45.591 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7efee00e9f20 con 0x7efee0148000 2020-07-06T13:18:45.591 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efedd824700 1 -- 172.21.15.118:0/4081687638 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed0001390 con 0x7efee0148000 2020-07-06T13:18:45.591 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- 172.21.15.118:0/4081687638 >> 172.21.15.118:6789/0 conn(0x7efee0148000 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-07-06T13:18:45.592 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- 172.21.15.118:0/4081687638 shutdown_connections 2020-07-06T13:18:45.592 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- 172.21.15.118:0/4081687638 shutdown_connections 2020-07-06T13:18:45.592 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- 172.21.15.118:0/4081687638 wait complete. 2020-07-06T13:18:45.592 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.587 7efee4938700 1 -- 172.21.15.118:0/4081687638 >> 172.21.15.118:0/4081687638 conn(0x7efee0143f30 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:45.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 Processor -- start 2020-07-06T13:18:45.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 -- - start start 2020-07-06T13:18:45.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00a3d10 con 0 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00a6ae0 con 0 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efede025700 1 -- 172.21.15.118:0/3185696162 learned_addr learned my addr 172.21.15.118:0/3185696162 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed4001ff0 con 0x7efee00a6330 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2260229678 0 0) 0x7efed40022f0 con 0x7efee00a6330 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efebc002960 con 0 2020-07-06T13:18:45.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed00011d0 con 0x7efee00a3320 2020-07-06T13:18:45.597 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2393508374 0 0) 0x7efed00037c0 con 0x7efee00a3320 2020-07-06T13:18:45.597 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efebc004620 con 0 2020-07-06T13:18:45.597 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3904064352 0 0) 0x7efed4000e50 con 0x7efee00a6330 2020-07-06T13:18:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efebc002ee0 con 0 2020-07-06T13:18:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (77715068 0 0) 0x7efed0003b40 con 0x7efee00a3320 2020-07-06T13:18:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efebc003540 con 0 2020-07-06T13:18:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2917963297 0 0) 0x7efed4001510 con 0x7efee00a6330 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 >> 172.21.15.118:6790/0 conn(0x7efee00a3320 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee007aac0 con 0 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee0071170 con 0 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7efed4000bf0 con 0x7efee00a6330 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7efed4001940 con 0x7efee00a6330 2020-07-06T13:18:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1882626267 0 0) 0x7efed4003f90 con 0x7efee00a6330 2020-07-06T13:18:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efee4938700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efee018b130 con 0 2020-07-06T13:18:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.591 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 718+0+0 (525653505 0 0) 0x7efed40049f0 con 0x7efee00a6330 2020-07-06T13:18:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.599 7efee4938700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee007ae60 con 0 2020-07-06T13:18:45.604 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.603 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7efee007ae60 con 0x7efee00a6330 2020-07-06T13:18:45.678 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.679 7efee4938700 1 -- 172.21.15.118:0/3185696162 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd new", "uuid": "c6be8af8-e07a-4192-8f17-7763c852c626", "id": 0} v 0) v1 -- 0x7efee00731b0 con 0 2020-07-06T13:18:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.691 7efecffff700 1 -- 172.21.15.118:0/3185696162 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6be8af8-e07a-4192-8f17-7763c852c626", "id": 0}]=0 v3) v1 ==== 112+0+2 (1627446612 0 732707515) 0x7efed4005020 con 0x7efee00a6330 2020-07-06T13:18:45.694 INFO:teuthology.orchestra.run.smithi118.stdout:0 2020-07-06T13:18:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.695 7efee4938700 1 -- 172.21.15.118:0/3185696162 >> 172.21.15.118:6791/0 conn(0x7efee00a6330 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-07-06T13:18:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.695 7efee4938700 1 -- 172.21.15.118:0/3185696162 shutdown_connections 2020-07-06T13:18:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.695 7efee4938700 1 -- 172.21.15.118:0/3185696162 shutdown_connections 2020-07-06T13:18:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.695 7efee4938700 1 -- 172.21.15.118:0/3185696162 wait complete. 2020-07-06T13:18:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.695 7efee4938700 1 -- 172.21.15.118:0/3185696162 >> 172.21.15.118:0/3185696162 conn(0x7efee00994e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:45.706 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new d6455359-2116-4bb1-acc1-91d5e15f9c18 1 2020-07-06T13:18:45.790 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 Processor -- start 2020-07-06T13:18:45.790 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- - start start 2020-07-06T13:18:45.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b814ba40 con 0 2020-07-06T13:18:45.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b814bde0 con 0 2020-07-06T13:18:45.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11aeffd700 1 -- 172.21.15.118:0/2620165862 learned_addr learned my addr 172.21.15.118:0/2620165862 2020-07-06T13:18:45.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a0003630 con 0x7f11b814b300 2020-07-06T13:18:45.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2545802230 0 0) 0x7f11a00039b0 con 0x7f11b814b300 2020-07-06T13:18:45.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1198002a20 con 0 2020-07-06T13:18:45.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a80022a0 con 0x7f11b8148000 2020-07-06T13:18:45.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1381023316 0 0) 0x7f11a80025a0 con 0x7f11b8148000 2020-07-06T13:18:45.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f11980046c0 con 0 2020-07-06T13:18:45.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4117140332 0 0) 0x7f11a0003f80 con 0x7f11b814b300 2020-07-06T13:18:45.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 >> 172.21.15.118:6791/0 conn(0x7f11b8148000 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-07-06T13:18:45.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b807a860 con 0 2020-07-06T13:18:45.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f11a0000bf0 con 0x7f11b814b300 2020-07-06T13:18:45.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11b6ffd700 1 -- 172.21.15.118:0/2620165862 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a0001050 con 0x7f11b814b300 2020-07-06T13:18:45.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- 172.21.15.118:0/2620165862 >> 172.21.15.118:6789/0 conn(0x7f11b814b300 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-07-06T13:18:45.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- 172.21.15.118:0/2620165862 shutdown_connections 2020-07-06T13:18:45.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- 172.21.15.118:0/2620165862 shutdown_connections 2020-07-06T13:18:45.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- 172.21.15.118:0/2620165862 wait complete. 2020-07-06T13:18:45.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.791 7f11bdbc9700 1 -- 172.21.15.118:0/2620165862 >> 172.21.15.118:0/2620165862 conn(0x7f11b8143f30 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:45.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11bdbc9700 1 Processor -- start 2020-07-06T13:18:45.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11bdbc9700 1 -- - start start 2020-07-06T13:18:45.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11bdbc9700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b8092d40 con 0 2020-07-06T13:18:45.798 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11bdbc9700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b80a3fc0 con 0 2020-07-06T13:18:45.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11aeffd700 1 -- 172.21.15.118:0/1824773390 learned_addr learned my addr 172.21.15.118:0/1824773390 2020-07-06T13:18:45.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a8002ae0 con 0x7f11b80a3650 2020-07-06T13:18:45.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a0000e50 con 0x7f11b80a65d0 2020-07-06T13:18:45.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (926523325 0 0) 0x7f11a80020e0 con 0x7f11b80a3650 2020-07-06T13:18:45.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f119c002df0 con 0 2020-07-06T13:18:45.801 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (187864590 0 0) 0x7f11a0003380 con 0x7f11b80a65d0 2020-07-06T13:18:45.801 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.795 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f119c004620 con 0 2020-07-06T13:18:45.801 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2724075989 0 0) 0x7f11a0003710 con 0x7f11b80a65d0 2020-07-06T13:18:45.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f119c004df0 con 0 2020-07-06T13:18:45.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (696646764 0 0) 0x7f11a8002570 con 0x7f11b80a3650 2020-07-06T13:18:45.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f119c0034b0 con 0 2020-07-06T13:18:45.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3795290642 0 0) 0x7f11a0001570 con 0x7f11b80a65d0 2020-07-06T13:18:45.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 >> 172.21.15.118:6789/0 conn(0x7f11b80a3650 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b807aac0 con 0 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b8071260 con 0 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b818b690 con 0 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f11b8116db0 con 0x7f11b80a65d0 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f11a00019a0 con 0x7f11b80a65d0 2020-07-06T13:18:45.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1882626267 0 0) 0x7f11a0004440 con 0x7f11b80a65d0 2020-07-06T13:18:45.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.799 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 989+0+0 (3418778853 0 0) 0x7f11a0005030 con 0x7f11b80a65d0 2020-07-06T13:18:45.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.803 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190002050 con 0 2020-07-06T13:18:45.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.803 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f11a00049d0 con 0x7f11b80a65d0 2020-07-06T13:18:45.876 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.875 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd new", "uuid": "d6455359-2116-4bb1-acc1-91d5e15f9c18", "id": 1} v 0) v1 -- 0x7f1190001230 con 0 2020-07-06T13:18:45.886 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.887 7f11b57fa700 1 -- 172.21.15.118:0/1824773390 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6455359-2116-4bb1-acc1-91d5e15f9c18", "id": 1}]=0 v4) v1 ==== 112+0+2 (2917445933 0 940483276) 0x7f11a0004c10 con 0x7f11b80a65d0 2020-07-06T13:18:45.891 INFO:teuthology.orchestra.run.smithi118.stdout:1 2020-07-06T13:18:45.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.891 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 >> 172.21.15.118:6791/0 conn(0x7f11b80a65d0 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-07-06T13:18:45.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.891 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 shutdown_connections 2020-07-06T13:18:45.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.891 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 shutdown_connections 2020-07-06T13:18:45.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.891 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 wait complete. 2020-07-06T13:18:45.894 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.891 7f11bdbc9700 1 -- 172.21.15.118:0/1824773390 >> 172.21.15.118:0/1824773390 conn(0x7f11b8099780 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:45.904 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 8b609f5d-862e-4579-8c93-a2175c7ccc38 2 2020-07-06T13:18:45.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 Processor -- start 2020-07-06T13:18:45.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- - start start 2020-07-06T13:18:45.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272814ba30 con 0 2020-07-06T13:18:45.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272814bdd0 con 0 2020-07-06T13:18:45.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726d71700 1 -- 172.21.15.118:0/168341801 learned_addr learned my addr 172.21.15.118:0/168341801 2020-07-06T13:18:45.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2718003630 con 0x7f272814b2f0 2020-07-06T13:18:45.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (22551062 0 0) 0x7f27180039b0 con 0x7f272814b2f0 2020-07-06T13:18:45.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2714002a20 con 0 2020-07-06T13:18:45.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f271c0022a0 con 0x7f2728147ff0 2020-07-06T13:18:45.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4203845206 0 0) 0x7f271c0025a0 con 0x7f2728147ff0 2020-07-06T13:18:45.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f27140046c0 con 0 2020-07-06T13:18:45.994 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3857424610 0 0) 0x7f2718003f80 con 0x7f272814b2f0 2020-07-06T13:18:45.994 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 >> 172.21.15.118:6790/0 conn(0x7f2728147ff0 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-07-06T13:18:45.994 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272807a850 con 0 2020-07-06T13:18:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2728116da0 con 0x7f272814b2f0 2020-07-06T13:18:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f2726570700 1 -- 172.21.15.118:0/168341801 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2718001050 con 0x7f272814b2f0 2020-07-06T13:18:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- 172.21.15.118:0/168341801 >> 172.21.15.118:6789/0 conn(0x7f272814b2f0 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-07-06T13:18:45.997 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- 172.21.15.118:0/168341801 shutdown_connections 2020-07-06T13:18:45.998 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- 172.21.15.118:0/168341801 shutdown_connections 2020-07-06T13:18:45.998 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- 172.21.15.118:0/168341801 wait complete. 2020-07-06T13:18:45.998 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.991 7f272d78d700 1 -- 172.21.15.118:0/168341801 >> 172.21.15.118:0/168341801 conn(0x7f2728143f20 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:45.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 Processor -- start 2020-07-06T13:18:45.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 -- - start start 2020-07-06T13:18:45.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280a3c20 con 0 2020-07-06T13:18:45.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280a69f0 con 0 2020-07-06T13:18:45.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2727572700 1 -- 172.21.15.118:0/1279734820 learned_addr learned my addr 172.21.15.118:0/1279734820 2020-07-06T13:18:46.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2718000e50 con 0x7f27280a6240 2020-07-06T13:18:46.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f271c0020e0 con 0x7f27280a3230 2020-07-06T13:18:46.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3788611922 0 0) 0x7f2718003380 con 0x7f27280a6240 2020-07-06T13:18:46.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2708002df0 con 0 2020-07-06T13:18:46.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3386905389 0 0) 0x7f271c0023e0 con 0x7f27280a3230 2020-07-06T13:18:46.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2708004620 con 0 2020-07-06T13:18:46.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (268991152 0 0) 0x7f2718003700 con 0x7f27280a6240 2020-07-06T13:18:46.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2708004df0 con 0 2020-07-06T13:18:46.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3101051436 0 0) 0x7f271c002650 con 0x7f27280a3230 2020-07-06T13:18:46.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2708006570 con 0 2020-07-06T13:18:46.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3708658916 0 0) 0x7f271c0010f0 con 0x7f27280a3230 2020-07-06T13:18:46.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 >> 172.21.15.118:6790/0 conn(0x7f27280a6240 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-07-06T13:18:46.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272807aab0 con 0 2020-07-06T13:18:46.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2728071160 con 0 2020-07-06T13:18:46.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f272d78d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f272818b0a0 con 0 2020-07-06T13:18:46.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f27280e9f10 con 0x7f27280a3230 2020-07-06T13:18:46.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f271c001520 con 0x7f27280a3230 2020-07-06T13:18:46.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1882626267 0 0) 0x7f271c001b20 con 0x7f27280a3230 2020-07-06T13:18:46.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:45.995 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1260+0+0 (3682810100 0 0) 0x7f271c004e10 con 0x7f27280a3230 2020-07-06T13:18:46.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.003 7f272d78d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2704002050 con 0 2020-07-06T13:18:46.009 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.007 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f271c004490 con 0x7f27280a3230 2020-07-06T13:18:46.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.083 7f272d78d700 1 -- 172.21.15.118:0/1279734820 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8b609f5d-862e-4579-8c93-a2175c7ccc38", "id": 2} v 0) v1 -- 0x7f27040012a0 con 0 2020-07-06T13:18:46.092 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.091 7f2724d6d700 1 -- 172.21.15.118:0/1279734820 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b609f5d-862e-4579-8c93-a2175c7ccc38", "id": 2}]=0 v5) v1 ==== 112+0+2 (3887583139 0 216599125) 0x7f271c004870 con 0x7f27280a3230 2020-07-06T13:18:46.099 INFO:teuthology.orchestra.run.smithi118.stdout:2 2020-07-06T13:18:46.100 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.099 7f272d78d700 1 -- 172.21.15.118:0/1279734820 >> 172.21.15.118:6789/0 conn(0x7f27280a3230 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-07-06T13:18:46.100 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.099 7f272d78d700 1 -- 172.21.15.118:0/1279734820 shutdown_connections 2020-07-06T13:18:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.099 7f272d78d700 1 -- 172.21.15.118:0/1279734820 shutdown_connections 2020-07-06T13:18:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.099 7f272d78d700 1 -- 172.21.15.118:0/1279734820 wait complete. 2020-07-06T13:18:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.099 7f272d78d700 1 -- 172.21.15.118:0/1279734820 >> 172.21.15.118:0/1279734820 conn(0x7f2728099320 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:46.111 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 725283f8-d498-435b-b418-72041ff08ad1 3 2020-07-06T13:18:46.194 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f491d907700 1 Processor -- start 2020-07-06T13:18:46.195 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f491d907700 1 -- - start start 2020-07-06T13:18:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f491d907700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491814baa0 con 0 2020-07-06T13:18:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f491d907700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491814be40 con 0 2020-07-06T13:18:46.197 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49177fe700 1 -- 172.21.15.118:0/112343328 learned_addr learned my addr 172.21.15.118:0/112343328 2020-07-06T13:18:46.197 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f49080039b0 con 0x7f4918148060 2020-07-06T13:18:46.197 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1096928038 0 0) 0x7f4908003d30 con 0x7f4918148060 2020-07-06T13:18:46.197 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4904002a20 con 0 2020-07-06T13:18:46.197 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f490c0022a0 con 0x7f491814b360 2020-07-06T13:18:46.198 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (427493574 0 0) 0x7f490c002620 con 0x7f491814b360 2020-07-06T13:18:46.198 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f49040046c0 con 0 2020-07-06T13:18:46.198 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3067653739 0 0) 0x7f490c002ac0 con 0x7f491814b360 2020-07-06T13:18:46.198 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 >> 172.21.15.118:6789/0 conn(0x7f4918148060 :-1 s=STATE_OPEN pgs=16 cs=1 l=1).mark_down 2020-07-06T13:18:46.198 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491807a8c0 con 0 2020-07-06T13:18:46.199 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4918116e10 con 0x7f491814b360 2020-07-06T13:18:46.199 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f49167fc700 1 -- 172.21.15.118:0/112343328 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f490c001010 con 0x7f491814b360 2020-07-06T13:18:46.200 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.195 7f491d907700 1 -- 172.21.15.118:0/112343328 >> 172.21.15.118:6790/0 conn(0x7f491814b360 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-07-06T13:18:46.200 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 -- 172.21.15.118:0/112343328 shutdown_connections 2020-07-06T13:18:46.200 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 -- 172.21.15.118:0/112343328 shutdown_connections 2020-07-06T13:18:46.200 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 -- 172.21.15.118:0/112343328 wait complete. 2020-07-06T13:18:46.200 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 -- 172.21.15.118:0/112343328 >> 172.21.15.118:0/112343328 conn(0x7f4918143f90 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:46.201 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 Processor -- start 2020-07-06T13:18:46.201 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.199 7f491d907700 1 -- - start start 2020-07-06T13:18:46.202 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f491d907700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49180a3e20 con 0 2020-07-06T13:18:46.202 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f491d907700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49180a5340 con 0 2020-07-06T13:18:46.202 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f49177fe700 1 -- 172.21.15.118:0/1561291719 learned_addr learned my addr 172.21.15.118:0/1561291719 2020-07-06T13:18:46.204 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f490c000e50 con 0x7f4918095c80 2020-07-06T13:18:46.204 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3475871037 0 0) 0x7f490c002080 con 0x7f4918095c80 2020-07-06T13:18:46.204 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f48f8002960 con 0 2020-07-06T13:18:46.205 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f49080037c0 con 0x7f49180a3430 2020-07-06T13:18:46.205 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3833990101 0 0) 0x7f4908003a80 con 0x7f49180a3430 2020-07-06T13:18:46.205 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f48f8004620 con 0 2020-07-06T13:18:46.205 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2354598475 0 0) 0x7f490c0024d0 con 0x7f4918095c80 2020-07-06T13:18:46.206 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48f8002ee0 con 0 2020-07-06T13:18:46.206 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1221991513 0 0) 0x7f4908003cf0 con 0x7f49180a3430 2020-07-06T13:18:46.206 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48f8003540 con 0 2020-07-06T13:18:46.206 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (65982684 0 0) 0x7f490c0017d0 con 0x7f4918095c80 2020-07-06T13:18:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 >> 172.21.15.118:6790/0 conn(0x7f49180a3430 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-07-06T13:18:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491807ab20 con 0 2020-07-06T13:18:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f491d907700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49180711d0 con 0 2020-07-06T13:18:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f490c001320 con 0x7f4918095c80 2020-07-06T13:18:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f491d907700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180a6c70 con 0 2020-07-06T13:18:46.208 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f490c001c00 con 0x7f4918095c80 2020-07-06T13:18:46.208 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1882626267 0 0) 0x7f490c0030a0 con 0x7f4918095c80 2020-07-06T13:18:46.208 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.203 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1531+0+0 (4075703881 0 0) 0x7f490c003740 con 0x7f4918095c80 2020-07-06T13:18:46.208 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.207 7f491d907700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491807aec0 con 0 2020-07-06T13:18:46.212 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.211 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f491807aec0 con 0x7f4918095c80 2020-07-06T13:18:46.285 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.283 7f491d907700 1 -- 172.21.15.118:0/1561291719 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "725283f8-d498-435b-b418-72041ff08ad1", "id": 3} v 0) v1 -- 0x7f4918073210 con 0 2020-07-06T13:18:46.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.291 7f4914ff9700 1 -- 172.21.15.118:0/1561291719 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "725283f8-d498-435b-b418-72041ff08ad1", "id": 3}]=0 v6) v1 ==== 112+0+2 (2492597129 0 525046306) 0x7f490c004020 con 0x7f4918095c80 2020-07-06T13:18:46.292 INFO:teuthology.orchestra.run.smithi118.stdout:3 2020-07-06T13:18:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.291 7f491d907700 1 -- 172.21.15.118:0/1561291719 >> 172.21.15.118:6789/0 conn(0x7f4918095c80 :-1 s=STATE_OPEN pgs=17 cs=1 l=1).mark_down 2020-07-06T13:18:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.295 7f491d907700 1 -- 172.21.15.118:0/1561291719 shutdown_connections 2020-07-06T13:18:46.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.295 7f491d907700 1 -- 172.21.15.118:0/1561291719 shutdown_connections 2020-07-06T13:18:46.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.295 7f491d907700 1 -- 172.21.15.118:0/1561291719 wait complete. 2020-07-06T13:18:46.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:46.295 7f491d907700 1 -- 172.21.15.118:0/1561291719 >> 172.21.15.118:0/1561291719 conn(0x7f49180995f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:46.309 INFO:tasks.ceph.osd.0:Restarting daemon 2020-07-06T13:18:46.310 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-07-06T13:18:46.312 INFO:tasks.ceph.osd.0:Started 2020-07-06T13:18:46.312 INFO:tasks.ceph.osd.1:Restarting daemon 2020-07-06T13:18:46.313 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-07-06T13:18:46.315 INFO:tasks.ceph.osd.1:Started 2020-07-06T13:18:46.315 INFO:tasks.ceph.osd.2:Restarting daemon 2020-07-06T13:18:46.316 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-07-06T13:18:46.317 INFO:tasks.ceph.osd.2:Started 2020-07-06T13:18:46.318 INFO:tasks.ceph.osd.3:Restarting daemon 2020-07-06T13:18:46.318 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-07-06T13:18:46.320 INFO:tasks.ceph.osd.3:Started 2020-07-06T13:18:46.320 INFO:tasks.ceph:Waiting for OSDs to come up 2020-07-06T13:18:46.376 INFO:tasks.ceph.osd.1.smithi118.stdout:starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal 2020-07-06T13:18:46.380 INFO:tasks.ceph.osd.2.smithi118.stdout:starting osd.2 at - osd_data /var/lib/ceph/osd/ceph-2 /var/lib/ceph/osd/ceph-2/journal 2020-07-06T13:18:46.395 INFO:tasks.ceph.osd.0.smithi118.stdout:starting osd.0 at - osd_data /var/lib/ceph/osd/ceph-0 /var/lib/ceph/osd/ceph-0/journal 2020-07-06T13:18:46.396 INFO:tasks.ceph.osd.3.smithi118.stdout:starting osd.3 at - osd_data /var/lib/ceph/osd/ceph-3 /var/lib/ceph/osd/ceph-3/journal 2020-07-06T13:18:46.723 INFO:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-06T13:18:46.802 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 Processor -- start 2020-07-06T13:18:46.803 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- - start start 2020-07-06T13:18:46.803 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274414ba40 con 0 2020-07-06T13:18:46.803 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274414bde0 con 0 2020-07-06T13:18:46.804 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274a342700 1 -- 172.21.15.118:0/1858672696 learned_addr learned my addr 172.21.15.118:0/1858672696 2020-07-06T13:18:46.806 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2740003630 con 0x7f2744148000 2020-07-06T13:18:46.806 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1294095421 0 0) 0x7f27400039b0 con 0x7f2744148000 2020-07-06T13:18:46.807 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f272c002a20 con 0 2020-07-06T13:18:46.807 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f27340022a0 con 0x7f274414b300 2020-07-06T13:18:46.807 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4169021399 0 0) 0x7f27340025a0 con 0x7f274414b300 2020-07-06T13:18:46.808 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f272c0046c0 con 0 2020-07-06T13:18:46.808 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2175274249 0 0) 0x7f2740003eb0 con 0x7f2744148000 2020-07-06T13:18:46.808 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 >> 172.21.15.118:6789/0 conn(0x7f274414b300 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-07-06T13:18:46.809 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274407a940 con 0 2020-07-06T13:18:46.809 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f27440e9f20 con 0x7f2744148000 2020-07-06T13:18:46.809 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- 172.21.15.118:0/1858672696 >> 172.21.15.118:6791/0 conn(0x7f2744148000 :-1 s=STATE_OPEN pgs=17 cs=1 l=1).mark_down 2020-07-06T13:18:46.810 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f2749340700 1 -- 172.21.15.118:0/1858672696 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2740001010 con 0x7f2744148000 2020-07-06T13:18:46.810 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- 172.21.15.118:0/1858672696 shutdown_connections 2020-07-06T13:18:46.811 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- 172.21.15.118:0/1858672696 shutdown_connections 2020-07-06T13:18:46.811 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- 172.21.15.118:0/1858672696 wait complete. 2020-07-06T13:18:46.811 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.803 7f274c31c700 1 -- 172.21.15.118:0/1858672696 >> 172.21.15.118:0/1858672696 conn(0x7f2744143f30 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:46.822 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 Processor -- start 2020-07-06T13:18:46.822 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 -- - start start 2020-07-06T13:18:46.822 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440a3c40 con 0 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440a6a10 con 0 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f2749b41700 1 -- 172.21.15.118:0/1094873209 learned_addr learned my addr 172.21.15.118:0/1094873209 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f27340020b0 con 0x7f27440a6260 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1172127365 0 0) 0x7f2734002430 con 0x7f27440a6260 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2724002960 con 0 2020-07-06T13:18:46.823 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2740000e50 con 0x7f27440a3250 2020-07-06T13:18:46.824 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2363666488 0 0) 0x7f2740001530 con 0x7f27440a3250 2020-07-06T13:18:46.824 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2724004620 con 0 2020-07-06T13:18:46.824 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3994115107 0 0) 0x7f2734000f70 con 0x7f27440a6260 2020-07-06T13:18:46.824 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2724002ee0 con 0 2020-07-06T13:18:46.824 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2765214623 0 0) 0x7f27400018b0 con 0x7f27440a3250 2020-07-06T13:18:46.825 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2724003540 con 0 2020-07-06T13:18:46.825 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2437186808 0 0) 0x7f27340015a0 con 0x7f27440a6260 2020-07-06T13:18:46.825 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 >> 172.21.15.118:6791/0 conn(0x7f27440a3250 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=18 cs=1 l=1).mark_down 2020-07-06T13:18:46.825 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274407aba0 con 0 2020-07-06T13:18:46.825 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440729e0 con 0 2020-07-06T13:18:46.826 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f274c31c700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f274418aff0 con 0 2020-07-06T13:18:46.826 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2744116db0 con 0x7f27440a6260 2020-07-06T13:18:46.826 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f27340019d0 con 0x7f27440a6260 2020-07-06T13:18:46.826 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f27340044b0 con 0x7f27440a6260 2020-07-06T13:18:46.826 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.807 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1802+0+0 (4103390766 0 0) 0x7f2734005900 con 0x7f27440a6260 2020-07-06T13:18:46.827 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.815 7f274c31c700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2720002050 con 0 2020-07-06T13:18:46.827 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.823 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2734005ba0 con 0x7f27440a6260 2020-07-06T13:18:46.912 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.911 7f274c31c700 1 -- 172.21.15.118:0/1094873209 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27200011c0 con 0 2020-07-06T13:18:46.912 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.911 7f27337fe700 1 -- 172.21.15.118:0/1094873209 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+2575 (3955300355 0 1360634490) 0x7f2734003f90 con 0x7f27440a6260 2020-07-06T13:18:46.913 INFO:teuthology.misc.health.smithi118.stdout: 2020-07-06T13:18:46.913 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":6,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:46.288690","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:46.915 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 >> 172.21.15.118:6800/9723 conn(0x7f2724006ed0 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-07-06T13:18:46.915 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 >> 172.21.15.118:6789/0 conn(0x7f27440a6260 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-07-06T13:18:46.915 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 shutdown_connections 2020-07-06T13:18:46.915 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 shutdown_connections 2020-07-06T13:18:46.915 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 wait complete. 2020-07-06T13:18:46.916 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:46.915 7f274c31c700 1 -- 172.21.15.118:0/1094873209 >> 172.21.15.118:0/1094873209 conn(0x7f27440993c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:46.922 DEBUG:teuthology.misc:0 of 4 OSDs are up 2020-07-06T13:18:46.988 INFO:tasks.ceph.osd.1.smithi118.stderr:2020-07-06 13:18:46.987 7fb2db412c00 -1 osd.1 0 log_to_monitors {default=true} 2020-07-06T13:18:47.016 INFO:tasks.ceph.osd.3.smithi118.stderr:2020-07-06 13:18:47.011 7ff4bcfcbc00 -1 osd.3 0 log_to_monitors {default=true} 2020-07-06T13:18:47.221 INFO:tasks.ceph.osd.2.smithi118.stderr:2020-07-06 13:18:47.219 7f2338025c00 -1 osd.2 0 log_to_monitors {default=true} 2020-07-06T13:18:47.257 INFO:tasks.ceph.osd.0.smithi118.stderr:2020-07-06 13:18:47.255 7f6214442c00 -1 osd.0 0 log_to_monitors {default=true} 2020-07-06T13:18:48.416 INFO:tasks.ceph.osd.1.smithi118.stderr:2020-07-06 13:18:48.415 7fb2b5812700 -1 osd.1 0 waiting for initial osdmap 2020-07-06T13:18:48.422 INFO:tasks.ceph.osd.2.smithi118.stderr:2020-07-06 13:18:48.423 7f2312425700 -1 osd.2 0 waiting for initial osdmap 2020-07-06T13:18:48.424 INFO:tasks.ceph.osd.3.smithi118.stderr:2020-07-06 13:18:48.423 7ff4973cb700 -1 osd.3 0 waiting for initial osdmap 2020-07-06T13:18:48.425 INFO:tasks.ceph.osd.0.smithi118.stderr:2020-07-06 13:18:48.427 7f61ee842700 -1 osd.0 0 waiting for initial osdmap 2020-07-06T13:18:53.326 INFO:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-06T13:18:53.418 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 Processor -- start 2020-07-06T13:18:53.419 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 -- - start start 2020-07-06T13:18:53.420 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe014ba50 con 0 2020-07-06T13:18:53.420 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe014bdf0 con 0 2020-07-06T13:18:53.420 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdffff700 1 -- 172.21.15.118:0/139590951 learned_addr learned my addr 172.21.15.118:0/139590951 2020-07-06T13:18:53.421 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fcc003630 con 0x7f8fe014b310 2020-07-06T13:18:53.421 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2079867158 0 0) 0x7f8fcc0039b0 con 0x7f8fe014b310 2020-07-06T13:18:53.421 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8fc4002a20 con 0 2020-07-06T13:18:53.421 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fd40022a0 con 0x7f8fe0148010 2020-07-06T13:18:53.422 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (516140939 0 0) 0x7f8fd40025a0 con 0x7f8fe0148010 2020-07-06T13:18:53.422 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8fc40046c0 con 0 2020-07-06T13:18:53.422 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2176063931 0 0) 0x7f8fcc003f80 con 0x7f8fe014b310 2020-07-06T13:18:53.422 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 >> 172.21.15.118:6790/0 conn(0x7f8fe0148010 :-1 s=STATE_OPEN pgs=18 cs=1 l=1).mark_down 2020-07-06T13:18:53.422 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe007a950 con 0 2020-07-06T13:18:53.423 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8fe0116dc0 con 0x7f8fe014b310 2020-07-06T13:18:53.423 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fdf7fe700 1 -- 172.21.15.118:0/139590951 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fcc001050 con 0x7f8fe014b310 2020-07-06T13:18:53.424 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 -- 172.21.15.118:0/139590951 >> 172.21.15.118:6789/0 conn(0x7f8fe014b310 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-07-06T13:18:53.424 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.419 7f8fe6f46700 1 -- 172.21.15.118:0/139590951 shutdown_connections 2020-07-06T13:18:53.424 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- 172.21.15.118:0/139590951 shutdown_connections 2020-07-06T13:18:53.424 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- 172.21.15.118:0/139590951 wait complete. 2020-07-06T13:18:53.424 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- 172.21.15.118:0/139590951 >> 172.21.15.118:0/139590951 conn(0x7f8fe0143f40 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:53.428 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 Processor -- start 2020-07-06T13:18:53.428 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- - start start 2020-07-06T13:18:53.428 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00a3ca0 con 0 2020-07-06T13:18:53.428 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe6f46700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00a69e0 con 0 2020-07-06T13:18:53.429 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fe4f6c700 1 -- 172.21.15.118:0/1563023406 learned_addr learned my addr 172.21.15.118:0/1563023406 2020-07-06T13:18:53.429 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fcc000e50 con 0x7f8fe00a6230 2020-07-06T13:18:53.429 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fd40020e0 con 0x7f8fe00a32b0 2020-07-06T13:18:53.430 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.423 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2997463684 0 0) 0x7f8fcc003380 con 0x7f8fe00a6230 2020-07-06T13:18:53.430 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8fc8002df0 con 0 2020-07-06T13:18:53.430 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2301617462 0 0) 0x7f8fd40023e0 con 0x7f8fe00a32b0 2020-07-06T13:18:53.431 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8fc8004620 con 0 2020-07-06T13:18:53.431 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3334468532 0 0) 0x7f8fd4002650 con 0x7f8fe00a32b0 2020-07-06T13:18:53.432 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8fc8004df0 con 0 2020-07-06T13:18:53.433 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4120821523 0 0) 0x7f8fcc003700 con 0x7f8fe00a6230 2020-07-06T13:18:53.433 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8fc8006570 con 0 2020-07-06T13:18:53.433 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4102713036 0 0) 0x7f8fd40010f0 con 0x7f8fe00a32b0 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 >> 172.21.15.118:6789/0 conn(0x7f8fe00a6230 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe007abb0 con 0 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe0072c80 con 0 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8fe00e9f30 con 0x7f8fe00a32b0 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8fd4001520 con 0x7f8fe00a32b0 2020-07-06T13:18:53.434 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f8fd4001a80 con 0x7f8fe00a32b0 2020-07-06T13:18:53.435 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe018afd0 con 0 2020-07-06T13:18:53.435 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.427 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (4082184917 0 0) 0x7f8fd4004e90 con 0x7f8fe00a32b0 2020-07-06T13:18:53.435 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.431 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00711f0 con 0 2020-07-06T13:18:53.436 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.435 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8fd4004850 con 0x7f8fe00a32b0 2020-07-06T13:18:53.526 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fe007af50 con 0 2020-07-06T13:18:53.527 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fddffb700 1 -- 172.21.15.118:0/1563023406 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+3011 (4128480379 0 2898079877) 0x7f8fe007af50 con 0x7f8fe00a32b0 2020-07-06T13:18:53.527 INFO:teuthology.misc.health.smithi118.stdout: 2020-07-06T13:18:53.528 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":9,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:49.423444","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:53.528 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 >> 172.21.15.118:6800/9723 conn(0x7f8fc80072a0 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-07-06T13:18:53.529 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 >> 172.21.15.118:6791/0 conn(0x7f8fe00a32b0 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-07-06T13:18:53.529 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 shutdown_connections 2020-07-06T13:18:53.529 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 shutdown_connections 2020-07-06T13:18:53.529 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 wait complete. 2020-07-06T13:18:53.530 INFO:teuthology.misc.health.smithi118.stderr:2020-07-06 13:18:53.527 7f8fe6f46700 1 -- 172.21.15.118:0/1563023406 >> 172.21.15.118:0/1563023406 conn(0x7f8fe00994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:53.536 DEBUG:teuthology.misc:4 of 4 OSDs are up 2020-07-06T13:18:53.537 INFO:tasks.ceph:Creating RBD pool 2020-07-06T13:18:53.537 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool create rbd 8 2020-07-06T13:18:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.623 7fb461937700 1 Processor -- start 2020-07-06T13:18:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.623 7fb461937700 1 -- - start start 2020-07-06T13:18:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.623 7fb461937700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c14ba70 con 0 2020-07-06T13:18:53.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.623 7fb461937700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c14be10 con 0 2020-07-06T13:18:53.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.623 7fb45b7fe700 1 -- 172.21.15.118:0/2336126669 learned_addr learned my addr 172.21.15.118:0/2336126669 2020-07-06T13:18:53.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb44c003630 con 0x7fb45c148030 2020-07-06T13:18:53.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3744298639 0 0) 0x7fb44c0039b0 con 0x7fb45c148030 2020-07-06T13:18:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb43c002a20 con 0 2020-07-06T13:18:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb4440022a0 con 0x7fb45c14b330 2020-07-06T13:18:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3096018592 0 0) 0x7fb4440025a0 con 0x7fb45c14b330 2020-07-06T13:18:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb43c0046b0 con 0 2020-07-06T13:18:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4271026294 0 0) 0x7fb44c003f80 con 0x7fb45c148030 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 >> 172.21.15.118:6791/0 conn(0x7fb45c14b330 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c07a7d0 con 0 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb45c0e9f50 con 0x7fb45c148030 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45a7fc700 1 -- 172.21.15.118:0/2336126669 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb44c001050 con 0x7fb45c148030 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- 172.21.15.118:0/2336126669 >> 172.21.15.118:6789/0 conn(0x7fb45c148030 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-07-06T13:18:53.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- 172.21.15.118:0/2336126669 shutdown_connections 2020-07-06T13:18:53.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- 172.21.15.118:0/2336126669 shutdown_connections 2020-07-06T13:18:53.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- 172.21.15.118:0/2336126669 wait complete. 2020-07-06T13:18:53.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- 172.21.15.118:0/2336126669 >> 172.21.15.118:0/2336126669 conn(0x7fb45c143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:53.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 Processor -- start 2020-07-06T13:18:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- - start start 2020-07-06T13:18:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0a3d40 con 0 2020-07-06T13:18:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb461937700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0a5260 con 0 2020-07-06T13:18:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb45b7fe700 1 -- 172.21.15.118:0/228698856 learned_addr learned my addr 172.21.15.118:0/228698856 2020-07-06T13:18:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb444002ae0 con 0x7fb45c0a3350 2020-07-06T13:18:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3295154986 0 0) 0x7fb4440020e0 con 0x7fb45c0a3350 2020-07-06T13:18:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb440002960 con 0 2020-07-06T13:18:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb44c000e50 con 0x7fb45c095bd0 2020-07-06T13:18:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1615349952 0 0) 0x7fb44c003380 con 0x7fb45c095bd0 2020-07-06T13:18:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb440004620 con 0 2020-07-06T13:18:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1890994207 0 0) 0x7fb444002600 con 0x7fb45c0a3350 2020-07-06T13:18:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.627 7fb458ff9700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb440002ee0 con 0 2020-07-06T13:18:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2360753397 0 0) 0x7fb44c003700 con 0x7fb45c095bd0 2020-07-06T13:18:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb440003540 con 0 2020-07-06T13:18:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2767386721 0 0) 0x7fb4440010f0 con 0x7fb45c0a3350 2020-07-06T13:18:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 >> 172.21.15.118:6789/0 conn(0x7fb45c095bd0 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-07-06T13:18:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c07aa30 con 0 2020-07-06T13:18:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb461937700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0b26c0 con 0 2020-07-06T13:18:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb461937700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0a6b40 con 0 2020-07-06T13:18:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb444000bf0 con 0x7fb45c0a3350 2020-07-06T13:18:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb444001520 con 0x7fb45c0a3350 2020-07-06T13:18:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fb444002ed0 con 0x7fb45c0a3350 2020-07-06T13:18:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.631 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (4082184917 0 0) 0x7fb4440047f0 con 0x7fb45c0a3350 2020-07-06T13:18:53.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.639 7fb461937700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434002050 con 0 2020-07-06T13:18:53.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.643 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb444001970 con 0x7fb45c0a3350 2020-07-06T13:18:53.735 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:53.735 7fb461937700 1 -- 172.21.15.118:0/228698856 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7fb434001280 con 0 2020-07-06T13:18:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.487 7fb458ff9700 1 -- 172.21.15.118:0/228698856 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (1706632610 0 0) 0x7fb444004000 con 0x7fb45c0a3350 2020-07-06T13:18:54.499 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'rbd' created 2020-07-06T13:18:54.501 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.499 7fb461937700 1 -- 172.21.15.118:0/228698856 >> 172.21.15.118:6800/9723 conn(0x7fb440006ed0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-07-06T13:18:54.501 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.499 7fb461937700 1 -- 172.21.15.118:0/228698856 >> 172.21.15.118:6790/0 conn(0x7fb45c0a3350 :-1 s=STATE_OPEN pgs=19 cs=1 l=1).mark_down 2020-07-06T13:18:54.501 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.503 7fb461937700 1 -- 172.21.15.118:0/228698856 shutdown_connections 2020-07-06T13:18:54.502 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.503 7fb461937700 1 -- 172.21.15.118:0/228698856 shutdown_connections 2020-07-06T13:18:54.502 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.503 7fb461937700 1 -- 172.21.15.118:0/228698856 wait complete. 2020-07-06T13:18:54.502 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.503 7fb461937700 1 -- 172.21.15.118:0/228698856 >> 172.21.15.118:0/228698856 conn(0x7fb45c099480 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:54.511 INFO:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-07-06T13:18:54.609 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08ef237700 1 Processor -- start 2020-07-06T13:18:54.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08ef237700 1 -- - start start 2020-07-06T13:18:54.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08ef237700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e814ba50 con 0 2020-07-06T13:18:54.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08ef237700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e814bdf0 con 0 2020-07-06T13:18:54.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08eca5c700 1 -- 172.21.15.118:0/1965993343 learned_addr learned my addr 172.21.15.118:0/1965993343 2020-07-06T13:18:54.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08e40022a0 con 0x7f08e8148010 2020-07-06T13:18:54.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08d8003630 con 0x7f08e814b310 2020-07-06T13:18:54.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2098901811 0 0) 0x7f08e4002620 con 0x7f08e8148010 2020-07-06T13:18:54.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f08cc002ea0 con 0 2020-07-06T13:18:54.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (275949913 0 0) 0x7f08d80039b0 con 0x7f08e814b310 2020-07-06T13:18:54.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f08cc0046b0 con 0 2020-07-06T13:18:54.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3483697480 0 0) 0x7f08e4002b10 con 0x7f08e8148010 2020-07-06T13:18:54.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 >> 172.21.15.118:6791/0 conn(0x7f08e814b310 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-07-06T13:18:54.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e807a950 con 0 2020-07-06T13:18:54.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f08e80e9f30 con 0x7f08e8148010 2020-07-06T13:18:54.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08dffff700 1 -- 172.21.15.118:0/1965993343 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08e4001010 con 0x7f08e8148010 2020-07-06T13:18:54.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.595 7f08ef237700 1 -- 172.21.15.118:0/1965993343 >> 172.21.15.118:6789/0 conn(0x7f08e8148010 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-07-06T13:18:54.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- 172.21.15.118:0/1965993343 shutdown_connections 2020-07-06T13:18:54.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- 172.21.15.118:0/1965993343 shutdown_connections 2020-07-06T13:18:54.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- 172.21.15.118:0/1965993343 wait complete. 2020-07-06T13:18:54.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- 172.21.15.118:0/1965993343 >> 172.21.15.118:0/1965993343 conn(0x7f08e8143f40 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:54.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 Processor -- start 2020-07-06T13:18:54.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- - start start 2020-07-06T13:18:54.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80a3d40 con 0 2020-07-06T13:18:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08ef237700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80a6920 con 0 2020-07-06T13:18:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.599 7f08eca5c700 1 -- 172.21.15.118:0/2492231528 learned_addr learned my addr 172.21.15.118:0/2492231528 2020-07-06T13:18:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08d8003470 con 0x7f08e80a62d0 2020-07-06T13:18:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1444336850 0 0) 0x7f08d8003d30 con 0x7f08e80a62d0 2020-07-06T13:18:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f08d0002960 con 0 2020-07-06T13:18:54.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08e4000e50 con 0x7f08e80a3380 2020-07-06T13:18:54.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (965050759 0 0) 0x7f08e4002050 con 0x7f08e80a3380 2020-07-06T13:18:54.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f08d0004620 con 0 2020-07-06T13:18:54.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (867175527 0 0) 0x7f08e40024f0 con 0x7f08e80a3380 2020-07-06T13:18:54.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f08d0002ee0 con 0 2020-07-06T13:18:54.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3449970534 0 0) 0x7f08d8000e50 con 0x7f08e80a62d0 2020-07-06T13:18:54.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f08d0003540 con 0 2020-07-06T13:18:54.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2534940867 0 0) 0x7f08e40017d0 con 0x7f08e80a3380 2020-07-06T13:18:54.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 >> 172.21.15.118:6791/0 conn(0x7f08e80a62d0 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=26 cs=1 l=1).mark_down 2020-07-06T13:18:54.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e807abb0 con 0 2020-07-06T13:18:54.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08ef237700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e8072ba0 con 0 2020-07-06T13:18:54.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08ef237700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e818b0b0 con 0 2020-07-06T13:18:54.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f08e4001320 con 0x7f08e80a3380 2020-07-06T13:18:54.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f08e4002cd0 con 0x7f08e80a3380 2020-07-06T13:18:54.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f08e4003430 con 0x7f08e80a3380 2020-07-06T13:18:54.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.603 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 2196+0+0 (2463282109 0 0) 0x7f08e4004ba0 con 0x7f08e80a3380 2020-07-06T13:18:54.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.607 7f08ef237700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e807af50 con 0 2020-07-06T13:18:54.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.615 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f08e807af50 con 0x7f08e80a3380 2020-07-06T13:18:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:54.703 7f08ef237700 1 -- 172.21.15.118:0/2492231528 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"} v 0) v1 -- 0x7f08e80732f0 con 0 2020-07-06T13:18:55.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.495 7f08de7fc700 1 -- 172.21.15.118:0/2492231528 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 178+0+0 (3289075488 0 0) 0x7f08e40030e0 con 0x7f08e80a3380 2020-07-06T13:18:55.519 INFO:teuthology.orchestra.run.smithi118.stderr:enabled application 'rbd' on pool 'rbd' 2020-07-06T13:18:55.521 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.519 7f08ef237700 1 -- 172.21.15.118:0/2492231528 >> 172.21.15.118:6800/9723 conn(0x7f08d0006ed0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-07-06T13:18:55.522 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.519 7f08ef237700 1 -- 172.21.15.118:0/2492231528 >> 172.21.15.118:6790/0 conn(0x7f08e80a3380 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-07-06T13:18:55.522 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.519 7f08ef237700 1 -- 172.21.15.118:0/2492231528 shutdown_connections 2020-07-06T13:18:55.522 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.523 7f08ef237700 1 -- 172.21.15.118:0/2492231528 shutdown_connections 2020-07-06T13:18:55.522 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.523 7f08ef237700 1 -- 172.21.15.118:0/2492231528 wait complete. 2020-07-06T13:18:55.522 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.523 7f08ef237700 1 -- 172.21.15.118:0/2492231528 >> 172.21.15.118:0/2492231528 conn(0x7f08e8099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:55.533 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-07-06T13:18:55.534 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:18:55.616 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 Processor -- start 2020-07-06T13:18:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- - start start 2020-07-06T13:18:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de014ba90 con 0 2020-07-06T13:18:55.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de014be30 con 0 2020-07-06T13:18:55.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de5c4e700 1 -- 172.21.15.118:0/2893762062 learned_addr learned my addr 172.21.15.118:0/2893762062 2020-07-06T13:18:55.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd00039b0 con 0x7f7de0148050 2020-07-06T13:18:55.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd40022a0 con 0x7f7de014b350 2020-07-06T13:18:55.629 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3458112828 0 0) 0x7f7dd0003d30 con 0x7f7de0148050 2020-07-06T13:18:55.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7dcc002ea0 con 0 2020-07-06T13:18:55.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1737819994 0 0) 0x7f7dd4002620 con 0x7f7de014b350 2020-07-06T13:18:55.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7dcc0046b0 con 0 2020-07-06T13:18:55.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (711868338 0 0) 0x7f7dd0004220 con 0x7f7de0148050 2020-07-06T13:18:55.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 >> 172.21.15.118:6790/0 conn(0x7f7de014b350 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21 cs=1 l=1).mark_down 2020-07-06T13:18:55.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de007a7f0 con 0 2020-07-06T13:18:55.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7de00e9f70 con 0x7f7de0148050 2020-07-06T13:18:55.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- 172.21.15.118:0/2893762062 >> 172.21.15.118:6789/0 conn(0x7f7de0148050 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=31 cs=1 l=1).mark_down 2020-07-06T13:18:55.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de4c4c700 1 -- 172.21.15.118:0/2893762062 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd0001390 con 0x7f7de0148050 2020-07-06T13:18:55.632 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- 172.21.15.118:0/2893762062 shutdown_connections 2020-07-06T13:18:55.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.627 7f7de7c28700 1 -- 172.21.15.118:0/2893762062 shutdown_connections 2020-07-06T13:18:55.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 -- 172.21.15.118:0/2893762062 wait complete. 2020-07-06T13:18:55.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 -- 172.21.15.118:0/2893762062 >> 172.21.15.118:0/2893762062 conn(0x7f7de0143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:55.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 Processor -- start 2020-07-06T13:18:55.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 -- - start start 2020-07-06T13:18:55.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00a3b90 con 0 2020-07-06T13:18:55.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de7c28700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00a6960 con 0 2020-07-06T13:18:55.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.631 7f7de5c4e700 1 -- 172.21.15.118:0/1363220926 learned_addr learned my addr 172.21.15.118:0/1363220926 2020-07-06T13:18:55.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd00011d0 con 0x7f7de00a31a0 2020-07-06T13:18:55.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (590993858 0 0) 0x7f7dd0003760 con 0x7f7de00a31a0 2020-07-06T13:18:55.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7dc0002960 con 0 2020-07-06T13:18:55.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd4002b60 con 0x7f7de00a61b0 2020-07-06T13:18:55.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2318833198 0 0) 0x7f7dd4002080 con 0x7f7de00a61b0 2020-07-06T13:18:55.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7dc0004620 con 0 2020-07-06T13:18:55.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1524411602 0 0) 0x7f7dd0003cd0 con 0x7f7de00a31a0 2020-07-06T13:18:55.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7dc0002ee0 con 0 2020-07-06T13:18:55.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3315000279 0 0) 0x7f7dd40024e0 con 0x7f7de00a61b0 2020-07-06T13:18:55.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7dc0003540 con 0 2020-07-06T13:18:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1741136243 0 0) 0x7f7dd0001b50 con 0x7f7de00a31a0 2020-07-06T13:18:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 >> 172.21.15.118:6790/0 conn(0x7f7de00a61b0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-07-06T13:18:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de007aa50 con 0 2020-07-06T13:18:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de00b27e0 con 0 2020-07-06T13:18:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de018b050 con 0 2020-07-06T13:18:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7dd00016a0 con 0x7f7de00a31a0 2020-07-06T13:18:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dd0001f80 con 0x7f7de00a31a0 2020-07-06T13:18:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f7dd0004d10 con 0x7f7de00a31a0 2020-07-06T13:18:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.635 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (2084722238 0 0) 0x7f7dd0006520 con 0x7f7de00a31a0 2020-07-06T13:18:55.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.639 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de007add0 con 0 2020-07-06T13:18:55.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.643 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f7de007add0 con 0x7f7de00a31a0 2020-07-06T13:18:55.738 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de0156350 con 0 2020-07-06T13:18:55.739 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7ddeffd700 1 -- 172.21.15.118:0/1363220926 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+4100 (238102980 0 3075371060) 0x7f7dd0005210 con 0x7f7de00a31a0 2020-07-06T13:18:55.739 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:55.740 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":11,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:55.487942","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:55.741 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 >> 172.21.15.118:6800/9723 conn(0x7f7dc0006ef0 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-07-06T13:18:55.742 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 >> 172.21.15.118:6791/0 conn(0x7f7de00a31a0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-07-06T13:18:55.742 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 shutdown_connections 2020-07-06T13:18:55.742 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 shutdown_connections 2020-07-06T13:18:55.743 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 wait complete. 2020-07-06T13:18:55.744 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.739 7f7de7c28700 1 -- 172.21.15.118:0/1363220926 >> 172.21.15.118:0/1363220926 conn(0x7f7de00993a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-07-06T13:18:55.751 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:18:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:55.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 Processor -- start 2020-07-06T13:18:55.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- - start start 2020-07-06T13:18:55.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638014ba80 con 0 2020-07-06T13:18:55.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638014be20 con 0 2020-07-06T13:18:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637effd700 1 -- 172.21.15.118:0/3650521830 learned_addr learned my addr 172.21.15.118:0/3650521830 2020-07-06T13:18:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f63780022a0 con 0x7f6380148040 2020-07-06T13:18:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1522238423 0 0) 0x7f6378002620 con 0x7f6380148040 2020-07-06T13:18:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6360002a20 con 0 2020-07-06T13:18:55.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6368003630 con 0x7f638014b340 2020-07-06T13:18:55.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1575123598 0 0) 0x7f63680039b0 con 0x7f638014b340 2020-07-06T13:18:55.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f63600046c0 con 0 2020-07-06T13:18:55.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1488218870 0 0) 0x7f6378002bf0 con 0x7f6380148040 2020-07-06T13:18:55.852 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 >> 172.21.15.118:6790/0 conn(0x7f638014b340 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-07-06T13:18:55.852 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638007a910 con 0 2020-07-06T13:18:55.852 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6378000bf0 con 0x7f6380148040 2020-07-06T13:18:55.852 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f637e7fc700 1 -- 172.21.15.118:0/3650521830 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6378001050 con 0x7f6380148040 2020-07-06T13:18:55.852 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- 172.21.15.118:0/3650521830 >> 172.21.15.118:6789/0 conn(0x7f6380148040 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-07-06T13:18:55.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- 172.21.15.118:0/3650521830 shutdown_connections 2020-07-06T13:18:55.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- 172.21.15.118:0/3650521830 shutdown_connections 2020-07-06T13:18:55.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- 172.21.15.118:0/3650521830 wait complete. 2020-07-06T13:18:55.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.847 7f6385ef1700 1 -- 172.21.15.118:0/3650521830 >> 172.21.15.118:0/3650521830 conn(0x7f6380143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:55.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 Processor -- start 2020-07-06T13:18:55.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 -- - start start 2020-07-06T13:18:55.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63800a4060 con 0 2020-07-06T13:18:55.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6380092d10 con 0 2020-07-06T13:18:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637f7fe700 1 -- 172.21.15.118:0/532393534 learned_addr learned my addr 172.21.15.118:0/532393534 2020-07-06T13:18:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6378000e50 con 0x7f63800a3670 2020-07-06T13:18:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3073176175 0 0) 0x7f6378001ff0 con 0x7f63800a3670 2020-07-06T13:18:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6364002960 con 0 2020-07-06T13:18:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6368003470 con 0x7f63800a65f0 2020-07-06T13:18:55.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1414892835 0 0) 0x7f6368003d40 con 0x7f63800a65f0 2020-07-06T13:18:55.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6364004620 con 0 2020-07-06T13:18:55.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3826677384 0 0) 0x7f6378002440 con 0x7f63800a3670 2020-07-06T13:18:55.876 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6364002ee0 con 0 2020-07-06T13:18:55.877 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1157069119 0 0) 0x7f6368000e50 con 0x7f63800a65f0 2020-07-06T13:18:55.877 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6364003540 con 0 2020-07-06T13:18:55.877 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1023620099 0 0) 0x7f6378001810 con 0x7f63800a3670 2020-07-06T13:18:55.877 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 >> 172.21.15.118:6789/0 conn(0x7f63800a65f0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-07-06T13:18:55.878 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638007ab70 con 0 2020-07-06T13:18:55.878 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63800713e0 con 0 2020-07-06T13:18:55.878 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f6385ef1700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f63800a5680 con 0 2020-07-06T13:18:55.878 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f63800e9f60 con 0x7f63800a3670 2020-07-06T13:18:55.878 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6378001c40 con 0x7f63800a3670 2020-07-06T13:18:55.879 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f63780033f0 con 0x7f63800a3670 2020-07-06T13:18:55.879 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.851 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (2084722238 0 0) 0x7f6378005cd0 con 0x7f63800a3670 2020-07-06T13:18:55.879 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.855 7f6385ef1700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638007af10 con 0 2020-07-06T13:18:55.880 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.855 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f638007af10 con 0x7f63800a3670 2020-07-06T13:18:55.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.947 7f6385ef1700 1 -- 172.21.15.118:0/532393534 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f6380073300 con 0 2020-07-06T13:18:55.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.947 7f637cff9700 1 -- 172.21.15.118:0/532393534 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v11) v1 ==== 92+0+10 (846493769 0 265718887) 0x7f6378003be0 con 0x7f63800a3670 2020-07-06T13:18:55.950 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:18:55.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 >> 172.21.15.118:6800/9723 conn(0x7f6364006e70 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-07-06T13:18:55.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 >> 172.21.15.118:6790/0 conn(0x7f63800a3670 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-07-06T13:18:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 shutdown_connections 2020-07-06T13:18:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 shutdown_connections 2020-07-06T13:18:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 wait complete. 2020-07-06T13:18:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:55.951 7f6385ef1700 1 -- 172.21.15.118:0/532393534 >> 172.21.15.118:0/532393534 conn(0x7f6380099830 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:55.964 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-07-06T13:18:56.050 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:56.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e524e4700 1 Processor -- start 2020-07-06T13:18:56.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e524e4700 1 -- - start start 2020-07-06T13:18:56.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e524e4700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c14ba90 con 0 2020-07-06T13:18:56.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e524e4700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c14be30 con 0 2020-07-06T13:18:56.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e4bfff700 1 -- 172.21.15.118:0/1218116895 learned_addr learned my addr 172.21.15.118:0/1218116895 2020-07-06T13:18:56.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e3c003630 con 0x7f0e4c148050 2020-07-06T13:18:56.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (474820990 0 0) 0x7f0e3c0039b0 con 0x7f0e4c148050 2020-07-06T13:18:56.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e38002a20 con 0 2020-07-06T13:18:56.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.059 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e400022a0 con 0x7f0e4c14b350 2020-07-06T13:18:56.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1348049752 0 0) 0x7f0e40002620 con 0x7f0e4c14b350 2020-07-06T13:18:56.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e380046c0 con 0 2020-07-06T13:18:56.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3902705468 0 0) 0x7f0e3c003f80 con 0x7f0e4c148050 2020-07-06T13:18:56.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 >> 172.21.15.118:6791/0 conn(0x7f0e4c14b350 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-07-06T13:18:56.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c07a7f0 con 0 2020-07-06T13:18:56.064 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e4c0e9f70 con 0x7f0e4c148050 2020-07-06T13:18:56.064 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e4affd700 1 -- 172.21.15.118:0/1218116895 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e3c001050 con 0x7f0e4c148050 2020-07-06T13:18:56.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- 172.21.15.118:0/1218116895 >> 172.21.15.118:6789/0 conn(0x7f0e4c148050 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-07-06T13:18:56.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- 172.21.15.118:0/1218116895 shutdown_connections 2020-07-06T13:18:56.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- 172.21.15.118:0/1218116895 shutdown_connections 2020-07-06T13:18:56.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- 172.21.15.118:0/1218116895 wait complete. 2020-07-06T13:18:56.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- 172.21.15.118:0/1218116895 >> 172.21.15.118:0/1218116895 conn(0x7f0e4c143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:56.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 Processor -- start 2020-07-06T13:18:56.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.063 7f0e524e4700 1 -- - start start 2020-07-06T13:18:56.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e524e4700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0a3b90 con 0 2020-07-06T13:18:56.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e524e4700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0a6800 con 0 2020-07-06T13:18:56.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e4bfff700 1 -- 172.21.15.118:0/203622835 learned_addr learned my addr 172.21.15.118:0/203622835 2020-07-06T13:18:56.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e3c000e50 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3617186174 0 0) 0x7f0e3c001570 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e2c002960 con 0 2020-07-06T13:18:56.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e40002b60 con 0x7f0e4c0a61b0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3953212245 0 0) 0x7f0e400020e0 con 0x7f0e4c0a61b0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e2c004620 con 0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2436424594 0 0) 0x7f0e3c001920 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e2c002ee0 con 0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4002810911 0 0) 0x7f0e40002470 con 0x7f0e4c0a61b0 2020-07-06T13:18:56.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e2c003540 con 0 2020-07-06T13:18:56.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1403201564 0 0) 0x7f0e3c003620 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 >> 172.21.15.118:6789/0 conn(0x7f0e4c0a61b0 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-07-06T13:18:56.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c07aa50 con 0 2020-07-06T13:18:56.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e524e4700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0b2650 con 0 2020-07-06T13:18:56.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e524e4700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c18b010 con 0 2020-07-06T13:18:56.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e3c000bf0 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0e3c003a50 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f0e3c004780 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.067 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (2084722238 0 0) 0x7f0e3c005e50 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.074 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.075 7f0e524e4700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28002050 con 0 2020-07-06T13:18:56.080 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.079 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0e3c004260 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e28001200 con 0 2020-07-06T13:18:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e497fa700 1 -- 172.21.15.118:0/203622835 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v11) v1 ==== 84+0+64 (203525128 0 1889981992) 0x7f0e3c005120 con 0x7f0e4c0a31a0 2020-07-06T13:18:56.171 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:56.171 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2020-07-06T13:18:56.172 INFO:teuthology.orchestra.run.smithi118.stdout: { 2020-07-06T13:18:56.172 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2020-07-06T13:18:56.172 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": "rbd" 2020-07-06T13:18:56.172 INFO:teuthology.orchestra.run.smithi118.stdout: } 2020-07-06T13:18:56.172 INFO:teuthology.orchestra.run.smithi118.stdout:] 2020-07-06T13:18:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 >> 172.21.15.118:6800/9723 conn(0x7f0e2c006e70 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-07-06T13:18:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 >> 172.21.15.118:6790/0 conn(0x7f0e4c0a31a0 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-07-06T13:18:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 shutdown_connections 2020-07-06T13:18:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 shutdown_connections 2020-07-06T13:18:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 wait complete. 2020-07-06T13:18:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.171 7f0e524e4700 1 -- 172.21.15.118:0/203622835 >> 172.21.15.118:0/203622835 conn(0x7f0e4c0992f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:56.182 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-07-06T13:18:56.183 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-07-06T13:18:56.271 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:56.280 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb43e8bf700 1 Processor -- start 2020-07-06T13:18:56.281 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb43e8bf700 1 -- - start start 2020-07-06T13:18:56.281 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb43e8bf700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43814ba70 con 0 2020-07-06T13:18:56.283 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb43e8bf700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43814be10 con 0 2020-07-06T13:18:56.283 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb437fff700 1 -- 172.21.15.118:0/801014059 learned_addr learned my addr 172.21.15.118:0/801014059 2020-07-06T13:18:56.288 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb428002620 con 0x7fb438148030 2020-07-06T13:18:56.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3461003332 0 0) 0x7fb4280029a0 con 0x7fb438148030 2020-07-06T13:18:56.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb418002a20 con 0 2020-07-06T13:18:56.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb4200035b0 con 0x7fb43814b330 2020-07-06T13:18:56.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2288389621 0 0) 0x7fb4200038b0 con 0x7fb43814b330 2020-07-06T13:18:56.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.279 7fb4377fe700 1 -- 172.21.15.118:0/801014059 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb4180046c0 con 0 2020-07-06T13:18:56.291 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2783282499 0 0) 0x7fb428002f70 con 0x7fb438148030 2020-07-06T13:18:56.291 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb4377fe700 1 -- 172.21.15.118:0/801014059 >> 172.21.15.118:6790/0 conn(0x7fb43814b330 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-07-06T13:18:56.291 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb4377fe700 1 -- 172.21.15.118:0/801014059 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43807a900 con 0 2020-07-06T13:18:56.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb428000f70 con 0x7fb438148030 2020-07-06T13:18:56.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb4377fe700 1 -- 172.21.15.118:0/801014059 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb4280013d0 con 0x7fb438148030 2020-07-06T13:18:56.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- 172.21.15.118:0/801014059 >> 172.21.15.118:6789/0 conn(0x7fb438148030 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-07-06T13:18:56.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- 172.21.15.118:0/801014059 shutdown_connections 2020-07-06T13:18:56.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- 172.21.15.118:0/801014059 shutdown_connections 2020-07-06T13:18:56.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- 172.21.15.118:0/801014059 wait complete. 2020-07-06T13:18:56.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- 172.21.15.118:0/801014059 >> 172.21.15.118:0/801014059 conn(0x7fb438143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:56.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 Processor -- start 2020-07-06T13:18:56.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- - start start 2020-07-06T13:18:56.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380a3f70 con 0 2020-07-06T13:18:56.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43e8bf700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb438092c40 con 0 2020-07-06T13:18:56.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb43c8e5700 1 -- 172.21.15.118:0/1861074601 learned_addr learned my addr 172.21.15.118:0/1861074601 2020-07-06T13:18:56.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb4200035b0 con 0x7fb4380a5330 2020-07-06T13:18:56.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1914555625 0 0) 0x7fb420003990 con 0x7fb4380a5330 2020-07-06T13:18:56.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb41c002960 con 0 2020-07-06T13:18:56.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb4280011d0 con 0x7fb4380a3580 2020-07-06T13:18:56.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (798844840 0 0) 0x7fb428002370 con 0x7fb4380a3580 2020-07-06T13:18:56.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.283 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb41c004620 con 0 2020-07-06T13:18:56.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (576426995 0 0) 0x7fb420003ee0 con 0x7fb4380a5330 2020-07-06T13:18:56.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb41c002ee0 con 0 2020-07-06T13:18:56.300 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1171703146 0 0) 0x7fb4280026f0 con 0x7fb4380a3580 2020-07-06T13:18:56.300 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb41c003540 con 0 2020-07-06T13:18:56.300 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2968971005 0 0) 0x7fb4200010f0 con 0x7fb4380a5330 2020-07-06T13:18:56.300 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 >> 172.21.15.118:6790/0 conn(0x7fb4380a3580 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-07-06T13:18:56.300 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43807ab60 con 0 2020-07-06T13:18:56.301 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4380712e0 con 0 2020-07-06T13:18:56.301 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb420000bf0 con 0x7fb4380a5330 2020-07-06T13:18:56.301 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4380a6e70 con 0 2020-07-06T13:18:56.301 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb420001520 con 0x7fb4380a5330 2020-07-06T13:18:56.301 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fb420001970 con 0x7fb4380a5330 2020-07-06T13:18:56.302 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.287 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (2084722238 0 0) 0x7fb420004f80 con 0x7fb4380a5330 2020-07-06T13:18:56.303 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.295 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43807af00 con 0 2020-07-06T13:18:56.303 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.299 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb43807af00 con 0x7fb4380a5330 2020-07-06T13:18:56.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.391 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb438156330 con 0 2020-07-06T13:18:56.500 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.499 7fb435ffb700 1 -- 172.21.15.118:0/1861074601 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v12) v1 ==== 133+0+0 (3604228011 0 0) 0x7fb420004900 con 0x7fb4380a5330 2020-07-06T13:18:56.504 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2020-07-06T13:18:56.509 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 >> 172.21.15.118:6800/9723 conn(0x7fb41c006ed0 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-07-06T13:18:56.510 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 >> 172.21.15.118:6789/0 conn(0x7fb4380a5330 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-07-06T13:18:56.510 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 shutdown_connections 2020-07-06T13:18:56.510 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 shutdown_connections 2020-07-06T13:18:56.510 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 wait complete. 2020-07-06T13:18:56.511 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.507 7fb43e8bf700 1 -- 172.21.15.118:0/1861074601 >> 172.21.15.118:0/1861074601 conn(0x7fb438099720 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:56.518 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-07-06T13:18:56.597 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 Processor -- start 2020-07-06T13:18:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- - start start 2020-07-06T13:18:56.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485814ba70 con 0 2020-07-06T13:18:56.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485814be10 con 0 2020-07-06T13:18:56.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f4856ffd700 1 -- 172.21.15.118:0/3759319892 learned_addr learned my addr 172.21.15.118:0/3759319892 2020-07-06T13:18:56.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4840003630 con 0x7f485814b330 2020-07-06T13:18:56.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f48480022a0 con 0x7f4858148030 2020-07-06T13:18:56.609 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1798884192 0 0) 0x7f48400039b0 con 0x7f485814b330 2020-07-06T13:18:56.609 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4838002ea0 con 0 2020-07-06T13:18:56.609 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2042570474 0 0) 0x7f4848002620 con 0x7f4858148030 2020-07-06T13:18:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f48380046b0 con 0 2020-07-06T13:18:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3525415513 0 0) 0x7f4848002ac0 con 0x7f4858148030 2020-07-06T13:18:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 >> 172.21.15.118:6790/0 conn(0x7f485814b330 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-07-06T13:18:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485807a900 con 0 2020-07-06T13:18:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4848000bf0 con 0x7f4858148030 2020-07-06T13:18:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f48567fc700 1 -- 172.21.15.118:0/3759319892 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4848001010 con 0x7f4858148030 2020-07-06T13:18:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- 172.21.15.118:0/3759319892 >> 172.21.15.118:6789/0 conn(0x7f4858148030 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-07-06T13:18:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- 172.21.15.118:0/3759319892 shutdown_connections 2020-07-06T13:18:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- 172.21.15.118:0/3759319892 shutdown_connections 2020-07-06T13:18:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- 172.21.15.118:0/3759319892 wait complete. 2020-07-06T13:18:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.607 7f485d850700 1 -- 172.21.15.118:0/3759319892 >> 172.21.15.118:0/3759319892 conn(0x7f4858143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 Processor -- start 2020-07-06T13:18:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 -- - start start 2020-07-06T13:18:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580a3f70 con 0 2020-07-06T13:18:56.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4858092c40 con 0 2020-07-06T13:18:56.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f48577fe700 1 -- 172.21.15.118:0/2494503366 learned_addr learned my addr 172.21.15.118:0/2494503366 2020-07-06T13:18:56.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4848000e50 con 0x7f48580a3580 2020-07-06T13:18:56.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3060776830 0 0) 0x7f48480020b0 con 0x7f48580a3580 2020-07-06T13:18:56.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f483c002960 con 0 2020-07-06T13:18:56.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4840003f40 con 0x7f48580a5330 2020-07-06T13:18:56.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1141695295 0 0) 0x7f4840003380 con 0x7f48580a5330 2020-07-06T13:18:56.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f483c004620 con 0 2020-07-06T13:18:56.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2448592393 0 0) 0x7f4848002500 con 0x7f48580a3580 2020-07-06T13:18:56.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f483c002ee0 con 0 2020-07-06T13:18:56.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4108679166 0 0) 0x7f4840003860 con 0x7f48580a5330 2020-07-06T13:18:56.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f483c003540 con 0 2020-07-06T13:18:56.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2539837896 0 0) 0x7f48480017d0 con 0x7f48580a3580 2020-07-06T13:18:56.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 >> 172.21.15.118:6791/0 conn(0x7f48580a5330 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-07-06T13:18:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485807ab60 con 0 2020-07-06T13:18:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48580712b0 con 0 2020-07-06T13:18:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f485d850700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f48580a6e50 con 0 2020-07-06T13:18:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f48580e9f50 con 0x7f48580a3580 2020-07-06T13:18:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4848001c00 con 0x7f48580a3580 2020-07-06T13:18:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f48480033f0 con 0x7f48580a3580 2020-07-06T13:18:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.611 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 2477+0+0 (2127233045 0 0) 0x7f4848003a90 con 0x7f48580a3580 2020-07-06T13:18:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.619 7f485d850700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4830002050 con 0 2020-07-06T13:18:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.623 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4848002ea0 con 0x7f48580a3580 2020-07-06T13:18:56.716 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:56.715 7f485d850700 1 -- 172.21.15.118:0/2494503366 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f4830001280 con 0 2020-07-06T13:18:57.503 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.503 7f4854ff9700 1 -- 172.21.15.118:0/2494503366 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v13) v1 ==== 125+0+0 (4153913060 0 0) 0x7f4848004fa0 con 0x7f48580a3580 2020-07-06T13:18:57.531 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2020-07-06T13:18:57.532 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 >> 172.21.15.118:6800/9723 conn(0x7f483c006ed0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-07-06T13:18:57.533 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 >> 172.21.15.118:6789/0 conn(0x7f48580a3580 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-07-06T13:18:57.533 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 shutdown_connections 2020-07-06T13:18:57.533 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 shutdown_connections 2020-07-06T13:18:57.533 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 wait complete. 2020-07-06T13:18:57.534 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.531 7f485d850700 1 -- 172.21.15.118:0/2494503366 >> 172.21.15.118:0/2494503366 conn(0x7f4858099720 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:57.543 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-07-06T13:18:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e43de700 1 Processor -- start 2020-07-06T13:18:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e43de700 1 -- - start start 2020-07-06T13:18:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e43de700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc14ba80 con 0 2020-07-06T13:18:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e43de700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc14be20 con 0 2020-07-06T13:18:57.636 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e2404700 1 -- 172.21.15.118:0/2147391112 learned_addr learned my addr 172.21.15.118:0/2147391112 2020-07-06T13:18:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89d8003630 con 0x7f89dc148040 2020-07-06T13:18:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2558731629 0 0) 0x7f89d80039b0 con 0x7f89dc148040 2020-07-06T13:18:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f89c4002a20 con 0 2020-07-06T13:18:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89cc0022a0 con 0x7f89dc14b340 2020-07-06T13:18:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2196251104 0 0) 0x7f89cc0025a0 con 0x7f89dc14b340 2020-07-06T13:18:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f89c40046c0 con 0 2020-07-06T13:18:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2836108048 0 0) 0x7f89d8003f80 con 0x7f89dc148040 2020-07-06T13:18:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 >> 172.21.15.118:6789/0 conn(0x7f89dc14b340 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-07-06T13:18:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc07a910 con 0 2020-07-06T13:18:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f89dc0e9f60 con 0x7f89dc148040 2020-07-06T13:18:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e1402700 1 -- 172.21.15.118:0/2147391112 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89d8001050 con 0x7f89dc148040 2020-07-06T13:18:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.635 7f89e43de700 1 -- 172.21.15.118:0/2147391112 >> 172.21.15.118:6790/0 conn(0x7f89dc148040 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-07-06T13:18:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.639 7f89e43de700 1 -- 172.21.15.118:0/2147391112 shutdown_connections 2020-07-06T13:18:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.639 7f89e43de700 1 -- 172.21.15.118:0/2147391112 shutdown_connections 2020-07-06T13:18:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.639 7f89e43de700 1 -- 172.21.15.118:0/2147391112 wait complete. 2020-07-06T13:18:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.639 7f89e43de700 1 -- 172.21.15.118:0/2147391112 >> 172.21.15.118:0/2147391112 conn(0x7f89dc143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 Processor -- start 2020-07-06T13:18:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 -- - start start 2020-07-06T13:18:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0a3d60 con 0 2020-07-06T13:18:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0a6b30 con 0 2020-07-06T13:18:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e1c03700 1 -- 172.21.15.118:0/1706593913 learned_addr learned my addr 172.21.15.118:0/1706593913 2020-07-06T13:18:57.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89cc0020e0 con 0x7f89dc0a6380 2020-07-06T13:18:57.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1188565776 0 0) 0x7f89cc0023e0 con 0x7f89dc0a6380 2020-07-06T13:18:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f89bc002960 con 0 2020-07-06T13:18:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89d8000e50 con 0x7f89dc0a3370 2020-07-06T13:18:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4283985415 0 0) 0x7f89d8003380 con 0x7f89dc0a3370 2020-07-06T13:18:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f89bc004620 con 0 2020-07-06T13:18:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (63898415 0 0) 0x7f89cc000e50 con 0x7f89dc0a6380 2020-07-06T13:18:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89bc002ee0 con 0 2020-07-06T13:18:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3004016437 0 0) 0x7f89d8003700 con 0x7f89dc0a3370 2020-07-06T13:18:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89bc003540 con 0 2020-07-06T13:18:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4067695557 0 0) 0x7f89cc0014b0 con 0x7f89dc0a6380 2020-07-06T13:18:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 >> 172.21.15.118:6791/0 conn(0x7f89dc0a3370 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-07-06T13:18:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc07ab70 con 0 2020-07-06T13:18:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc072da0 con 0 2020-07-06T13:18:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f89cc000bf0 con 0x7f89dc0a6380 2020-07-06T13:18:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89e43de700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc18b170 con 0 2020-07-06T13:18:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f89cc0018e0 con 0x7f89dc0a6380 2020-07-06T13:18:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f89cc0044b0 con 0x7f89dc0a6380 2020-07-06T13:18:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.643 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 2743+0+0 (866726220 0 0) 0x7f89cc004830 con 0x7f89dc0a6380 2020-07-06T13:18:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.647 7f89e43de700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc07af10 con 0 2020-07-06T13:18:57.652 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.651 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f89dc07af10 con 0x7f89dc0a6380 2020-07-06T13:18:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.747 7f89e43de700 1 -- 172.21.15.118:0/1706593913 --> 172.21.15.118:6789/0 -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f89dc073300 con 0 2020-07-06T13:18:57.748 INFO:tasks.ceph.mon.a.smithi118.stderr:2020-07-06 13:18:57.747 7ff52d055700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-07-06T13:18:57.751 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.751 7f89cb7fe700 1 -- 172.21.15.118:0/1706593913 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 192+0+0 (3633460107 0 0) 0x7f89cc003f90 con 0x7f89dc0a6380 2020-07-06T13:18:57.762 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 2 and data pool 3 2020-07-06T13:18:57.764 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 >> 172.21.15.118:6800/9723 conn(0x7f89bc006ed0 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-07-06T13:18:57.765 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 >> 172.21.15.118:6789/0 conn(0x7f89dc0a6380 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-07-06T13:18:57.765 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 shutdown_connections 2020-07-06T13:18:57.765 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 shutdown_connections 2020-07-06T13:18:57.765 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 wait complete. 2020-07-06T13:18:57.766 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.763 7f89e43de700 1 -- 172.21.15.118:0/1706593913 >> 172.21.15.118:0/1706593913 conn(0x7f89dc0994a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:57.777 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:18:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:57.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc73e85c700 1 Processor -- start 2020-07-06T13:18:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc73e85c700 1 -- - start start 2020-07-06T13:18:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc73e85c700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73814ba90 con 0 2020-07-06T13:18:57.860 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc73e85c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73814be30 con 0 2020-07-06T13:18:57.860 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc737fff700 1 -- 172.21.15.118:0/1030073536 learned_addr learned my addr 172.21.15.118:0/1030073536 2020-07-06T13:18:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc72c003630 con 0x7fc73814b350 2020-07-06T13:18:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (402678003 0 0) 0x7fc72c0039b0 con 0x7fc73814b350 2020-07-06T13:18:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc724002a20 con 0 2020-07-06T13:18:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc7280022a0 con 0x7fc738148050 2020-07-06T13:18:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1650152481 0 0) 0x7fc728002620 con 0x7fc738148050 2020-07-06T13:18:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc7240046c0 con 0 2020-07-06T13:18:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2326193254 0 0) 0x7fc728002ac0 con 0x7fc738148050 2020-07-06T13:18:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 >> 172.21.15.118:6791/0 conn(0x7fc73814b350 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-07-06T13:18:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73807a7f0 con 0 2020-07-06T13:18:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc7380e9f70 con 0x7fc738148050 2020-07-06T13:18:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc7377fe700 1 -- 172.21.15.118:0/1030073536 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc728001010 con 0x7fc738148050 2020-07-06T13:18:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.859 7fc73e85c700 1 -- 172.21.15.118:0/1030073536 >> 172.21.15.118:6789/0 conn(0x7fc738148050 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-07-06T13:18:57.864 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 -- 172.21.15.118:0/1030073536 shutdown_connections 2020-07-06T13:18:57.864 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 -- 172.21.15.118:0/1030073536 shutdown_connections 2020-07-06T13:18:57.864 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 -- 172.21.15.118:0/1030073536 wait complete. 2020-07-06T13:18:57.865 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 -- 172.21.15.118:0/1030073536 >> 172.21.15.118:0/1030073536 conn(0x7fc738143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:57.865 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 Processor -- start 2020-07-06T13:18:57.866 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.863 7fc73e85c700 1 -- - start start 2020-07-06T13:18:57.866 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc73e85c700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380a3c30 con 0 2020-07-06T13:18:57.866 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc73e85c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380a6970 con 0 2020-07-06T13:18:57.866 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc73c882700 1 -- 172.21.15.118:0/3264658822 learned_addr learned my addr 172.21.15.118:0/3264658822 2020-07-06T13:18:57.868 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc728001010 con 0x7fc7380a3240 2020-07-06T13:18:57.868 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1551711259 0 0) 0x7fc728002080 con 0x7fc7380a3240 2020-07-06T13:18:57.868 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc718002960 con 0 2020-07-06T13:18:57.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc72c003440 con 0x7fc7380a61c0 2020-07-06T13:18:57.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3209214198 0 0) 0x7fc72c003780 con 0x7fc7380a61c0 2020-07-06T13:18:57.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc718004620 con 0 2020-07-06T13:18:57.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2546643247 0 0) 0x7fc7280025f0 con 0x7fc7380a3240 2020-07-06T13:18:57.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc718002ee0 con 0 2020-07-06T13:18:57.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1179114177 0 0) 0x7fc72c000e50 con 0x7fc7380a61c0 2020-07-06T13:18:57.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc718003540 con 0 2020-07-06T13:18:57.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3528607802 0 0) 0x7fc72c001390 con 0x7fc7380a61c0 2020-07-06T13:18:57.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 >> 172.21.15.118:6791/0 conn(0x7fc7380a3240 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-07-06T13:18:57.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73807aa50 con 0 2020-07-06T13:18:57.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7380b2650 con 0 2020-07-06T13:18:57.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc72c000bf0 con 0x7fc7380a61c0 2020-07-06T13:18:57.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc72c0017c0 con 0x7fc7380a61c0 2020-07-06T13:18:57.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73818b120 con 0 2020-07-06T13:18:57.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fc72c001a00 con 0x7fc7380a61c0 2020-07-06T13:18:57.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.867 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3029995146 0 0) 0x7fc72c004c50 con 0x7fc7380a61c0 2020-07-06T13:18:57.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.871 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73807add0 con 0 2020-07-06T13:18:57.875 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.875 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fc73807add0 con 0x7fc7380a61c0 2020-07-06T13:18:57.967 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.967 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7380730f0 con 0 2020-07-06T13:18:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.967 7fc735ffb700 1 -- 172.21.15.118:0/3264658822 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 2746939814) 0x7fc72c004020 con 0x7fc7380a61c0 2020-07-06T13:18:57.970 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:57.970 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":14,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:57.750924","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:57.971 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 >> 172.21.15.118:6800/9723 conn(0x7fc718006e70 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-07-06T13:18:57.971 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 >> 172.21.15.118:6790/0 conn(0x7fc7380a61c0 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-07-06T13:18:57.971 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 shutdown_connections 2020-07-06T13:18:57.972 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 shutdown_connections 2020-07-06T13:18:57.972 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 wait complete. 2020-07-06T13:18:57.972 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:57.971 7fc73e85c700 1 -- 172.21.15.118:0/3264658822 >> 172.21.15.118:0/3264658822 conn(0x7fc7380993a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:57.981 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:18:58.065 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.071 7f9806f3f700 1 Processor -- start 2020-07-06T13:18:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.071 7f9806f3f700 1 -- - start start 2020-07-06T13:18:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.071 7f9806f3f700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980014ba90 con 0 2020-07-06T13:18:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.071 7f9806f3f700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980014be30 con 0 2020-07-06T13:18:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.071 7f9804f65700 1 -- 172.21.15.118:0/2749046539 learned_addr learned my addr 172.21.15.118:0/2749046539 2020-07-06T13:18:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f0003630 con 0x7f9800148050 2020-07-06T13:18:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f40022a0 con 0x7f980014b350 2020-07-06T13:18:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1959173494 0 0) 0x7f97f00039b0 con 0x7f9800148050 2020-07-06T13:18:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f97ec002ea0 con 0 2020-07-06T13:18:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2191422013 0 0) 0x7f97f4002620 con 0x7f980014b350 2020-07-06T13:18:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f97ec0046b0 con 0 2020-07-06T13:18:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1394082842 0 0) 0x7f97f0003ea0 con 0x7f9800148050 2020-07-06T13:18:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 >> 172.21.15.118:6791/0 conn(0x7f980014b350 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-07-06T13:18:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980007a7f0 con 0 2020-07-06T13:18:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f98000e9f70 con 0x7f9800148050 2020-07-06T13:18:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f97ff7fe700 1 -- 172.21.15.118:0/2749046539 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f0001010 con 0x7f9800148050 2020-07-06T13:18:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f9806f3f700 1 -- 172.21.15.118:0/2749046539 >> 172.21.15.118:6790/0 conn(0x7f9800148050 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-07-06T13:18:58.078 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f9806f3f700 1 -- 172.21.15.118:0/2749046539 shutdown_connections 2020-07-06T13:18:58.078 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f9806f3f700 1 -- 172.21.15.118:0/2749046539 shutdown_connections 2020-07-06T13:18:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f9806f3f700 1 -- 172.21.15.118:0/2749046539 wait complete. 2020-07-06T13:18:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.075 7f9806f3f700 1 -- 172.21.15.118:0/2749046539 >> 172.21.15.118:0/2749046539 conn(0x7f9800143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 Processor -- start 2020-07-06T13:18:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 -- - start start 2020-07-06T13:18:58.081 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98000a3dd0 con 0 2020-07-06T13:18:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98000a52f0 con 0 2020-07-06T13:18:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9804f65700 1 -- 172.21.15.118:0/3309269568 learned_addr learned my addr 172.21.15.118:0/3309269568 2020-07-06T13:18:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f0000e50 con 0x7f9800095c20 2020-07-06T13:18:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4237431937 0 0) 0x7f97f00033e0 con 0x7f9800095c20 2020-07-06T13:18:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f97e0002960 con 0 2020-07-06T13:18:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f40020e0 con 0x7f98000a33e0 2020-07-06T13:18:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3437814126 0 0) 0x7f97f40029a0 con 0x7f98000a33e0 2020-07-06T13:18:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f97e0004620 con 0 2020-07-06T13:18:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2732362239 0 0) 0x7f97f0003950 con 0x7f9800095c20 2020-07-06T13:18:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97e0002ee0 con 0 2020-07-06T13:18:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2943266493 0 0) 0x7f97f4002c10 con 0x7f98000a33e0 2020-07-06T13:18:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97e0003540 con 0 2020-07-06T13:18:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3960325443 0 0) 0x7f97f00017d0 con 0x7f9800095c20 2020-07-06T13:18:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 >> 172.21.15.118:6790/0 conn(0x7f98000a33e0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-07-06T13:18:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980007aa50 con 0 2020-07-06T13:18:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98000b2840 con 0 2020-07-06T13:18:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f98000a6c20 con 0 2020-07-06T13:18:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f97f0000bf0 con 0x7f9800095c20 2020-07-06T13:18:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f97f0001c00 con 0x7f9800095c20 2020-07-06T13:18:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f97f0004780 con 0x7f9800095c20 2020-07-06T13:18:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.079 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3029995146 0 0) 0x7f97f0006150 con 0x7f9800095c20 2020-07-06T13:18:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.087 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc002050 con 0 2020-07-06T13:18:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.091 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f97f0004db0 con 0x7f9800095c20 2020-07-06T13:18:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.179 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97dc001200 con 0 2020-07-06T13:18:58.183 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f97fdffb700 1 -- 172.21.15.118:0/3309269568 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 2746939814) 0x7f97f0004330 con 0x7f9800095c20 2020-07-06T13:18:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 >> 172.21.15.118:6800/9723 conn(0x7f97e0007460 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-07-06T13:18:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 >> 172.21.15.118:6791/0 conn(0x7f9800095c20 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-07-06T13:18:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 shutdown_connections 2020-07-06T13:18:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 shutdown_connections 2020-07-06T13:18:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 wait complete. 2020-07-06T13:18:58.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.183 7f9806f3f700 1 -- 172.21.15.118:0/3309269568 >> 172.21.15.118:0/3309269568 conn(0x7f9800099560 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:58.185 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:58.185 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":14,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:57.750924","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:58.193 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-07-06T13:18:58.286 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:58.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.287 7f029cc78700 1 Processor -- start 2020-07-06T13:18:58.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.287 7f029cc78700 1 -- - start start 2020-07-06T13:18:58.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029814ba80 con 0 2020-07-06T13:18:58.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029814be20 con 0 2020-07-06T13:18:58.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0296a68700 1 -- 172.21.15.118:0/1596769012 learned_addr learned my addr 172.21.15.118:0/1596769012 2020-07-06T13:18:58.293 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0288003630 con 0x7f0298148040 2020-07-06T13:18:58.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (313559574 0 0) 0x7f02880039b0 con 0x7f0298148040 2020-07-06T13:18:58.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0278002a20 con 0 2020-07-06T13:18:58.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f02800022a0 con 0x7f029814b340 2020-07-06T13:18:58.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (348444610 0 0) 0x7f0280002620 con 0x7f029814b340 2020-07-06T13:18:58.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02780046c0 con 0 2020-07-06T13:18:58.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3775080676 0 0) 0x7f0280002ac0 con 0x7f029814b340 2020-07-06T13:18:58.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 >> 172.21.15.118:6791/0 conn(0x7f0298148040 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=35 cs=1 l=1).mark_down 2020-07-06T13:18:58.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029807a910 con 0 2020-07-06T13:18:58.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0298116df0 con 0x7f029814b340 2020-07-06T13:18:58.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f0295a66700 1 -- 172.21.15.118:0/1596769012 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0280001010 con 0x7f029814b340 2020-07-06T13:18:58.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- 172.21.15.118:0/1596769012 >> 172.21.15.118:6789/0 conn(0x7f029814b340 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-07-06T13:18:58.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- 172.21.15.118:0/1596769012 shutdown_connections 2020-07-06T13:18:58.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- 172.21.15.118:0/1596769012 shutdown_connections 2020-07-06T13:18:58.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- 172.21.15.118:0/1596769012 wait complete. 2020-07-06T13:18:58.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.291 7f029cc78700 1 -- 172.21.15.118:0/1596769012 >> 172.21.15.118:0/1596769012 conn(0x7f0298143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:58.308 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f029cc78700 1 Processor -- start 2020-07-06T13:18:58.308 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f029cc78700 1 -- - start start 2020-07-06T13:18:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f029cc78700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980a3d80 con 0 2020-07-06T13:18:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f029cc78700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980a6ac0 con 0 2020-07-06T13:18:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f0296a68700 1 -- 172.21.15.118:0/4258152949 learned_addr learned my addr 172.21.15.118:0/4258152949 2020-07-06T13:18:58.310 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0280000e50 con 0x7f02980a6310 2020-07-06T13:18:58.310 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1829578621 0 0) 0x7f0280002080 con 0x7f02980a6310 2020-07-06T13:18:58.311 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f027c002960 con 0 2020-07-06T13:18:58.311 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0288003440 con 0x7f02980a3390 2020-07-06T13:18:58.311 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3059664665 0 0) 0x7f0288003700 con 0x7f02980a3390 2020-07-06T13:18:58.312 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f027c004620 con 0 2020-07-06T13:18:58.312 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2772141787 0 0) 0x7f02800024d0 con 0x7f02980a6310 2020-07-06T13:18:58.313 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f027c002ee0 con 0 2020-07-06T13:18:58.313 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4034120464 0 0) 0x7f0288003970 con 0x7f02980a3390 2020-07-06T13:18:58.313 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f027c003540 con 0 2020-07-06T13:18:58.314 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3528033061 0 0) 0x7f02800017d0 con 0x7f02980a6310 2020-07-06T13:18:58.314 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 >> 172.21.15.118:6791/0 conn(0x7f02980a3390 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-07-06T13:18:58.316 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.295 7f028ffff700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029807ab70 con 0 2020-07-06T13:18:58.317 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f029cc78700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02980712c0 con 0 2020-07-06T13:18:58.317 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f029cc78700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f029818b110 con 0 2020-07-06T13:18:58.317 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0280000bf0 con 0x7f02980a6310 2020-07-06T13:18:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0280001c00 con 0x7f02980a6310 2020-07-06T13:18:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f02800032c0 con 0x7f02980a6310 2020-07-06T13:18:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.299 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3029995146 0 0) 0x7f0280004c90 con 0x7f02980a6310 2020-07-06T13:18:58.319 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.303 7f029cc78700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0270002050 con 0 2020-07-06T13:18:58.320 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.307 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0280002da0 con 0x7f02980a6310 2020-07-06T13:18:58.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.399 7f029cc78700 1 -- 172.21.15.118:0/4258152949 --> 172.21.15.118:6789/0 -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f02700012a0 con 0 2020-07-06T13:18:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.767 7f028ffff700 1 -- 172.21.15.118:0/4258152949 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (2292374382 0 0) 0x7f0280003d00 con 0x7f02980a6310 2020-07-06T13:18:58.818 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 >> 172.21.15.118:6800/9723 conn(0x7f027c006e90 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-07-06T13:18:58.819 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 >> 172.21.15.118:6789/0 conn(0x7f02980a6310 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-07-06T13:18:58.819 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 shutdown_connections 2020-07-06T13:18:58.819 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 shutdown_connections 2020-07-06T13:18:58.819 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 wait complete. 2020-07-06T13:18:58.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.819 7f029cc78700 1 -- 172.21.15.118:0/4258152949 >> 172.21.15.118:0/4258152949 conn(0x7f0298099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:58.832 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:18:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e264f5700 1 Processor -- start 2020-07-06T13:18:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e264f5700 1 -- - start start 2020-07-06T13:18:58.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e264f5700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2014ba90 con 0 2020-07-06T13:18:58.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e264f5700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2014be30 con 0 2020-07-06T13:18:58.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1ffff700 1 -- 172.21.15.118:0/1962607778 learned_addr learned my addr 172.21.15.118:0/1962607778 2020-07-06T13:18:58.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e140022a0 con 0x7f2e2014b350 2020-07-06T13:18:58.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e10003630 con 0x7f2e20148050 2020-07-06T13:18:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2034202109 0 0) 0x7f2e14002620 con 0x7f2e2014b350 2020-07-06T13:18:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e0c002ea0 con 0 2020-07-06T13:18:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1847472285 0 0) 0x7f2e100039b0 con 0x7f2e20148050 2020-07-06T13:18:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.927 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e0c0046b0 con 0 2020-07-06T13:18:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (277900478 0 0) 0x7f2e14002b10 con 0x7f2e2014b350 2020-07-06T13:18:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 >> 172.21.15.118:6789/0 conn(0x7f2e20148050 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-07-06T13:18:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2007a7f0 con 0 2020-07-06T13:18:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2e20116e00 con 0x7f2e2014b350 2020-07-06T13:18:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e1effd700 1 -- 172.21.15.118:0/1962607778 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e14001010 con 0x7f2e2014b350 2020-07-06T13:18:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e264f5700 1 -- 172.21.15.118:0/1962607778 >> 172.21.15.118:6791/0 conn(0x7f2e2014b350 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-07-06T13:18:58.933 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e264f5700 1 -- 172.21.15.118:0/1962607778 shutdown_connections 2020-07-06T13:18:58.933 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e264f5700 1 -- 172.21.15.118:0/1962607778 shutdown_connections 2020-07-06T13:18:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e264f5700 1 -- 172.21.15.118:0/1962607778 wait complete. 2020-07-06T13:18:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.931 7f2e264f5700 1 -- 172.21.15.118:0/1962607778 >> 172.21.15.118:0/1962607778 conn(0x7f2e20143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:58.936 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 Processor -- start 2020-07-06T13:18:58.936 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 -- - start start 2020-07-06T13:18:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200a3c20 con 0 2020-07-06T13:18:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200a69f0 con 0 2020-07-06T13:18:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1ffff700 1 -- 172.21.15.118:0/367976216 learned_addr learned my addr 172.21.15.118:0/367976216 2020-07-06T13:18:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e10003470 con 0x7f2e200a3230 2020-07-06T13:18:58.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (784573725 0 0) 0x7f2e10003d30 con 0x7f2e200a3230 2020-07-06T13:18:58.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e00002960 con 0 2020-07-06T13:18:58.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e14000e50 con 0x7f2e200a6240 2020-07-06T13:18:58.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1571644328 0 0) 0x7f2e14002050 con 0x7f2e200a6240 2020-07-06T13:18:58.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e00004620 con 0 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2363692164 0 0) 0x7f2e10000e50 con 0x7f2e200a3230 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e00002ee0 con 0 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3738347440 0 0) 0x7f2e140022c0 con 0x7f2e200a6240 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e00003540 con 0 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (391473264 0 0) 0x7f2e10001360 con 0x7f2e200a3230 2020-07-06T13:18:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 >> 172.21.15.118:6791/0 conn(0x7f2e200a6240 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-07-06T13:18:58.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2007aa50 con 0 2020-07-06T13:18:58.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e200b2720 con 0 2020-07-06T13:18:58.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e264f5700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2018b180 con 0 2020-07-06T13:18:58.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2e10000bf0 con 0x7f2e200a3230 2020-07-06T13:18:58.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2e100019a0 con 0x7f2e200a3230 2020-07-06T13:18:58.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f2e10004780 con 0x7f2e200a3230 2020-07-06T13:18:58.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.935 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3642453284 0 0) 0x7f2e10005fc0 con 0x7f2e200a3230 2020-07-06T13:18:58.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.939 7f2e264f5700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2007add0 con 0 2020-07-06T13:18:58.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:58.947 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2e2007add0 con 0x7f2e200a3230 2020-07-06T13:18:59.033 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.031 7f2e264f5700 1 -- 172.21.15.118:0/367976216 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e20156350 con 0 2020-07-06T13:18:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e1d7fa700 1 -- 172.21.15.118:0/367976216 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1415 (2837298644 0 2329766481) 0x7f2e10004c60 con 0x7f2e200a3230 2020-07-06T13:18:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2020-07-06T13:18:59.034 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:59.035 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:18:58.753536","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:18:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 >> 172.21.15.118:6800/9723 conn(0x7f2e00006ed0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-07-06T13:18:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 >> 172.21.15.118:6789/0 conn(0x7f2e200a3230 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-07-06T13:18:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 shutdown_connections 2020-07-06T13:18:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 shutdown_connections 2020-07-06T13:18:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 wait complete. 2020-07-06T13:18:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.035 7f2e264f5700 1 -- 172.21.15.118:0/367976216 >> 172.21.15.118:0/367976216 conn(0x7f2e20099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.045 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:18:59.127 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:59.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1ba0f2700 1 Processor -- start 2020-07-06T13:18:59.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1ba0f2700 1 -- - start start 2020-07-06T13:18:59.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1ba0f2700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b414bad0 con 0 2020-07-06T13:18:59.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1ba0f2700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b414be70 con 0 2020-07-06T13:18:59.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1b37fe700 1 -- 172.21.15.118:0/2645585519 learned_addr learned my addr 172.21.15.118:0/2645585519 2020-07-06T13:18:59.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.131 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1a8003630 con 0x7fc1b414b340 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1ac002620 con 0x7fc1b4148040 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2468205356 0 0) 0x7fc1a80039b0 con 0x7fc1b414b340 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc1a0002ea0 con 0 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3302857953 0 0) 0x7fc1ac0029a0 con 0x7fc1b4148040 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc1a00046a0 con 0 2020-07-06T13:18:59.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3058689932 0 0) 0x7fc1ac002e40 con 0x7fc1b4148040 2020-07-06T13:18:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 >> 172.21.15.118:6790/0 conn(0x7fc1b414b340 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-07-06T13:18:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b407a7e0 con 0 2020-07-06T13:18:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc1b40e9f60 con 0x7fc1b4148040 2020-07-06T13:18:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1b2ffd700 1 -- 172.21.15.118:0/2645585519 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1ac001390 con 0x7fc1b4148040 2020-07-06T13:18:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1ba0f2700 1 -- 172.21.15.118:0/2645585519 >> 172.21.15.118:6789/0 conn(0x7fc1b4148040 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-07-06T13:18:59.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1ba0f2700 1 -- 172.21.15.118:0/2645585519 shutdown_connections 2020-07-06T13:18:59.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1ba0f2700 1 -- 172.21.15.118:0/2645585519 shutdown_connections 2020-07-06T13:18:59.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1ba0f2700 1 -- 172.21.15.118:0/2645585519 wait complete. 2020-07-06T13:18:59.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.135 7fc1ba0f2700 1 -- 172.21.15.118:0/2645585519 >> 172.21.15.118:0/2645585519 conn(0x7fc1b4143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 Processor -- start 2020-07-06T13:18:59.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 -- - start start 2020-07-06T13:18:59.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b40a3ed0 con 0 2020-07-06T13:18:59.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b40a6bc0 con 0 2020-07-06T13:18:59.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b3fff700 1 -- 172.21.15.118:0/3081274648 learned_addr learned my addr 172.21.15.118:0/3081274648 2020-07-06T13:18:59.141 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1ac001390 con 0x7fc1b40a3490 2020-07-06T13:18:59.141 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2425317007 0 0) 0x7fc1ac002430 con 0x7fc1b40a3490 2020-07-06T13:18:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc194002960 con 0 2020-07-06T13:18:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1a8003f40 con 0x7fc1b40a6410 2020-07-06T13:18:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3200711752 0 0) 0x7fc1a8003470 con 0x7fc1b40a6410 2020-07-06T13:18:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc194004620 con 0 2020-07-06T13:18:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3240235886 0 0) 0x7fc1ac0029a0 con 0x7fc1b40a3490 2020-07-06T13:18:59.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc194002ee0 con 0 2020-07-06T13:18:59.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3858258254 0 0) 0x7fc1a80038d0 con 0x7fc1b40a6410 2020-07-06T13:18:59.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc194003540 con 0 2020-07-06T13:18:59.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2207102885 0 0) 0x7fc1ac001cd0 con 0x7fc1b40a3490 2020-07-06T13:18:59.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 >> 172.21.15.118:6791/0 conn(0x7fc1b40a6410 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b407aa40 con 0 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b4071120 con 0 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc1ac000f70 con 0x7fc1b40a3490 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc1ac003250 con 0x7fc1b40a3490 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b418b6d0 con 0 2020-07-06T13:18:59.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fc1ac003c10 con 0x7fc1b40a3490 2020-07-06T13:18:59.145 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.139 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3642453284 0 0) 0x7fc1ac0036f0 con 0x7fc1b40a3490 2020-07-06T13:18:59.147 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.147 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b407adc0 con 0 2020-07-06T13:18:59.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.151 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fc1b407adc0 con 0x7fc1b40a3490 2020-07-06T13:18:59.247 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.247 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b4156340 con 0 2020-07-06T13:18:59.247 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.247 7fc1b17fa700 1 -- 172.21.15.118:0/3081274648 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1876768557) 0x7fc1ac005320 con 0x7fc1b40a3490 2020-07-06T13:18:59.248 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:59.248 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":15,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:58.752810","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:59.249 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.247 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 >> 172.21.15.118:6800/9723 conn(0x7fc1940064e0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-07-06T13:18:59.249 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.247 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 >> 172.21.15.118:6789/0 conn(0x7fc1b40a3490 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-07-06T13:18:59.250 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.247 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 shutdown_connections 2020-07-06T13:18:59.250 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.251 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 shutdown_connections 2020-07-06T13:18:59.250 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.251 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 wait complete. 2020-07-06T13:18:59.250 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.251 7fc1ba0f2700 1 -- 172.21.15.118:0/3081274648 >> 172.21.15.118:0/3081274648 conn(0x7fc1b4099650 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.258 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-07-06T13:18:59.259 INFO:tasks.ceph.mds.a:Restarting daemon 2020-07-06T13:18:59.259 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-07-06T13:18:59.261 INFO:tasks.ceph.mds.a:Started 2020-07-06T13:18:59.262 INFO:tasks.ceph.mds.b:Restarting daemon 2020-07-06T13:18:59.262 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-07-06T13:18:59.264 INFO:tasks.ceph.mds.b:Started 2020-07-06T13:18:59.265 INFO:tasks.ceph.mds.c:Restarting daemon 2020-07-06T13:18:59.265 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-07-06T13:18:59.267 INFO:tasks.ceph.mds.c:Started 2020-07-06T13:18:59.267 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:18:59.268 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-07-06T13:18:59.330 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at - 2020-07-06T13:18:59.336 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:59.339 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 Processor -- start 2020-07-06T13:18:59.339 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 -- - start start 2020-07-06T13:18:59.340 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec814ba80 con 0 2020-07-06T13:18:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec814be20 con 0 2020-07-06T13:18:59.343 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eccbaf700 1 -- 172.21.15.118:0/1960856647 learned_addr learned my addr 172.21.15.118:0/1960856647 2020-07-06T13:18:59.343 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3ec00039b0 con 0x7f3ec8148040 2020-07-06T13:18:59.343 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3617420278 0 0) 0x7f3ec0003d30 con 0x7f3ec8148040 2020-07-06T13:18:59.344 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ea8002a20 con 0 2020-07-06T13:18:59.344 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3eb00022a0 con 0x7f3ec814b340 2020-07-06T13:18:59.345 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (25375089 0 0) 0x7f3eb0002620 con 0x7f3ec814b340 2020-07-06T13:18:59.345 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ea80046c0 con 0 2020-07-06T13:18:59.345 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1462879642 0 0) 0x7f3ec0004300 con 0x7f3ec8148040 2020-07-06T13:18:59.345 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 >> 172.21.15.118:6789/0 conn(0x7f3ec814b340 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-07-06T13:18:59.345 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec807a7e0 con 0 2020-07-06T13:18:59.346 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3ec80e9f60 con 0x7f3ec8148040 2020-07-06T13:18:59.346 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3ec77fe700 1 -- 172.21.15.118:0/1960856647 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3ec00013d0 con 0x7f3ec8148040 2020-07-06T13:18:59.346 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 -- 172.21.15.118:0/1960856647 >> 172.21.15.118:6791/0 conn(0x7f3ec8148040 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-07-06T13:18:59.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.339 7f3eceb89700 1 -- 172.21.15.118:0/1960856647 shutdown_connections 2020-07-06T13:18:59.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- 172.21.15.118:0/1960856647 shutdown_connections 2020-07-06T13:18:59.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- 172.21.15.118:0/1960856647 wait complete. 2020-07-06T13:18:59.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- 172.21.15.118:0/1960856647 >> 172.21.15.118:0/1960856647 conn(0x7f3ec8143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 Processor -- start 2020-07-06T13:18:59.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- - start start 2020-07-06T13:18:59.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80a3e70 con 0 2020-07-06T13:18:59.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3eceb89700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80a5390 con 0 2020-07-06T13:18:59.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec7fff700 1 -- 172.21.15.118:0/978837489 learned_addr learned my addr 172.21.15.118:0/978837489 2020-07-06T13:18:59.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3eb00020e0 con 0x7f3ec80a3480 2020-07-06T13:18:59.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1290521411 0 0) 0x7f3eb00023e0 con 0x7f3ec80a3480 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3eac002960 con 0 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3ec00011d0 con 0x7f3ec8095c20 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3936010051 0 0) 0x7f3ec00018f0 con 0x7f3ec8095c20 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3eac004620 con 0 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (427241024 0 0) 0x7f3eb0000e50 con 0x7f3ec80a3480 2020-07-06T13:18:59.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3eac002ee0 con 0 2020-07-06T13:18:59.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1133000671 0 0) 0x7f3ec0001c70 con 0x7f3ec8095c20 2020-07-06T13:18:59.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3eac003540 con 0 2020-07-06T13:18:59.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.343 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2386055148 0 0) 0x7f3eb00013c0 con 0x7f3ec80a3480 2020-07-06T13:18:59.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 >> 172.21.15.118:6789/0 conn(0x7f3ec8095c20 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-07-06T13:18:59.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec807aa40 con 0 2020-07-06T13:18:59.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3eceb89700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80b27d0 con 0 2020-07-06T13:18:59.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3eceb89700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec80a6cc0 con 0 2020-07-06T13:18:59.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3ec8116df0 con 0x7f3ec80a3480 2020-07-06T13:18:59.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3eb00017f0 con 0x7f3ec80a3480 2020-07-06T13:18:59.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f3eb0001a30 con 0x7f3ec80a3480 2020-07-06T13:18:59.354 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.347 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3642453284 0 0) 0x7f3eb0005c40 con 0x7f3ec80a3480 2020-07-06T13:18:59.354 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at - 2020-07-06T13:18:59.354 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at - 2020-07-06T13:18:59.355 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.355 7f3eceb89700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec807adc0 con 0 2020-07-06T13:18:59.356 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.355 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f3ec807adc0 con 0x7f3ec80a3480 2020-07-06T13:18:59.440 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.439 7f3eceb89700 1 -- 172.21.15.118:0/978837489 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ec8156340 con 0 2020-07-06T13:18:59.440 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.439 7f3ec5ffb700 1 -- 172.21.15.118:0/978837489 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1876768557) 0x7f3eb0003f90 con 0x7f3ec80a3480 2020-07-06T13:18:59.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:18:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":15,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:58.752810","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:18:59.442 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 >> 172.21.15.118:6800/9723 conn(0x7f3eac006e70 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-07-06T13:18:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 >> 172.21.15.118:6790/0 conn(0x7f3ec80a3480 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-07-06T13:18:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 shutdown_connections 2020-07-06T13:18:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 shutdown_connections 2020-07-06T13:18:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 wait complete. 2020-07-06T13:18:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.443 7f3eceb89700 1 -- 172.21.15.118:0/978837489 >> 172.21.15.118:0/978837489 conn(0x7f3ec8099590 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.456 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-06 13:18:56.457152', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2020-07-06 13:18:56.782594', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-06T13:18:59.457 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:18:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:59.560 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.559 7f3814b21700 1 Processor -- start 2020-07-06T13:18:59.560 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.559 7f3814b21700 1 -- - start start 2020-07-06T13:18:59.561 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.559 7f3814b21700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381014ba70 con 0 2020-07-06T13:18:59.561 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.559 7f3814b21700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381014be10 con 0 2020-07-06T13:18:59.561 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.559 7f380e267700 1 -- 172.21.15.118:0/71449659 learned_addr learned my addr 172.21.15.118:0/71449659 2020-07-06T13:18:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3804003630 con 0x7f381014b330 2020-07-06T13:18:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1505838819 0 0) 0x7f38040039b0 con 0x7f381014b330 2020-07-06T13:18:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37f4002a20 con 0 2020-07-06T13:18:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3800002620 con 0x7f3810148030 2020-07-06T13:18:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3170240885 0 0) 0x7f38000029a0 con 0x7f3810148030 2020-07-06T13:18:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37f40046c0 con 0 2020-07-06T13:18:59.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (950993014 0 0) 0x7f3804003f80 con 0x7f381014b330 2020-07-06T13:18:59.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 >> 172.21.15.118:6791/0 conn(0x7f3810148030 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-07-06T13:18:59.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381007a900 con 0 2020-07-06T13:18:59.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3810116de0 con 0x7f381014b330 2020-07-06T13:18:59.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f380da66700 1 -- 172.21.15.118:0/71449659 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3804001050 con 0x7f381014b330 2020-07-06T13:18:59.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f3814b21700 1 -- 172.21.15.118:0/71449659 >> 172.21.15.118:6790/0 conn(0x7f381014b330 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-07-06T13:18:59.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f3814b21700 1 -- 172.21.15.118:0/71449659 shutdown_connections 2020-07-06T13:18:59.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f3814b21700 1 -- 172.21.15.118:0/71449659 shutdown_connections 2020-07-06T13:18:59.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f3814b21700 1 -- 172.21.15.118:0/71449659 wait complete. 2020-07-06T13:18:59.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.563 7f3814b21700 1 -- 172.21.15.118:0/71449659 >> 172.21.15.118:0/71449659 conn(0x7f3810143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.567 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 Processor -- start 2020-07-06T13:18:59.567 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 -- - start start 2020-07-06T13:18:59.567 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38100a3d70 con 0 2020-07-06T13:18:59.567 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3810095da0 con 0 2020-07-06T13:18:59.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f380ea68700 1 -- 172.21.15.118:0/114604842 learned_addr learned my addr 172.21.15.118:0/114604842 2020-07-06T13:18:59.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3804000e50 con 0x7f38100a5130 2020-07-06T13:18:59.570 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3800002460 con 0x7f38100a3380 2020-07-06T13:18:59.570 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (985875774 0 0) 0x7f3804001570 con 0x7f38100a5130 2020-07-06T13:18:59.570 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37ec002df0 con 0 2020-07-06T13:18:59.570 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2404296699 0 0) 0x7f3800002760 con 0x7f38100a3380 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37ec004620 con 0 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3420666647 0 0) 0x7f38000011d0 con 0x7f38100a3380 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37ec004df0 con 0 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1077139253 0 0) 0x7f3804001940 con 0x7f38100a5130 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37ec006570 con 0 2020-07-06T13:18:59.571 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1784306072 0 0) 0x7f3804003620 con 0x7f38100a5130 2020-07-06T13:18:59.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 >> 172.21.15.118:6790/0 conn(0x7f38100a3380 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-07-06T13:18:59.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381007ab60 con 0 2020-07-06T13:18:59.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3810072d90 con 0 2020-07-06T13:18:59.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f3814b21700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f38100a6a70 con 0 2020-07-06T13:18:59.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3804001360 con 0x7f38100a5130 2020-07-06T13:18:59.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3804003890 con 0x7f38100a5130 2020-07-06T13:18:59.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f3804004660 con 0x7f38100a5130 2020-07-06T13:18:59.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.567 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3642453284 0 0) 0x7f38040050a0 con 0x7f38100a5130 2020-07-06T13:18:59.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.575 7f3814b21700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381007af00 con 0 2020-07-06T13:18:59.579 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.579 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f381007af00 con 0x7f38100a5130 2020-07-06T13:18:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.671 7f3814b21700 1 -- 172.21.15.118:0/114604842 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f3810156330 con 0 2020-07-06T13:18:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.671 7f37fffff700 1 -- 172.21.15.118:0/114604842 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v15) v1 ==== 92+0+10 (4292913633 0 265718887) 0x7f3804004990 con 0x7f38100a5130 2020-07-06T13:18:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 >> 172.21.15.118:6800/9723 conn(0x7f37ec0072a0 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-07-06T13:18:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 >> 172.21.15.118:6791/0 conn(0x7f38100a5130 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-07-06T13:18:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 shutdown_connections 2020-07-06T13:18:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 shutdown_connections 2020-07-06T13:18:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 wait complete. 2020-07-06T13:18:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.675 7f3814b21700 1 -- 172.21.15.118:0/114604842 >> 172.21.15.118:0/114604842 conn(0x7f3810099490 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.676 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:18:59.683 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-06T13:18:59.766 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:18:59.784 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.783 7f6de694f700 1 Processor -- start 2020-07-06T13:18:59.785 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.783 7f6de694f700 1 -- - start start 2020-07-06T13:18:59.786 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6de694f700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de014ba70 con 0 2020-07-06T13:18:59.786 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6de694f700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de014be10 con 0 2020-07-06T13:18:59.786 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddffff700 1 -- 172.21.15.118:0/3938167711 learned_addr learned my addr 172.21.15.118:0/3938167711 2020-07-06T13:18:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dcc002220 con 0x7f6de0148030 2020-07-06T13:18:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dd4003630 con 0x7f6de014b330 2020-07-06T13:18:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (351068402 0 0) 0x7f6dcc0025a0 con 0x7f6de0148030 2020-07-06T13:18:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc4002ea0 con 0 2020-07-06T13:18:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (252152511 0 0) 0x7f6dd4003930 con 0x7f6de014b330 2020-07-06T13:18:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc40046b0 con 0 2020-07-06T13:18:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2649135754 0 0) 0x7f6dcc002a40 con 0x7f6de0148030 2020-07-06T13:18:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 >> 172.21.15.118:6790/0 conn(0x7f6de014b330 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-07-06T13:18:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de007a900 con 0 2020-07-06T13:18:59.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6de00e9f50 con 0x7f6de0148030 2020-07-06T13:18:59.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6ddf7fe700 1 -- 172.21.15.118:0/3938167711 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dcc001010 con 0x7f6de0148030 2020-07-06T13:18:59.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.787 7f6de694f700 1 -- 172.21.15.118:0/3938167711 >> 172.21.15.118:6789/0 conn(0x7f6de0148030 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-07-06T13:18:59.791 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- 172.21.15.118:0/3938167711 shutdown_connections 2020-07-06T13:18:59.791 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- 172.21.15.118:0/3938167711 shutdown_connections 2020-07-06T13:18:59.791 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- 172.21.15.118:0/3938167711 wait complete. 2020-07-06T13:18:59.792 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- 172.21.15.118:0/3938167711 >> 172.21.15.118:0/3938167711 conn(0x7f6de0143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 Processor -- start 2020-07-06T13:18:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- - start start 2020-07-06T13:18:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00a3d80 con 0 2020-07-06T13:18:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de694f700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de0095db0 con 0 2020-07-06T13:18:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6de4975700 1 -- 172.21.15.118:0/3702706505 learned_addr learned my addr 172.21.15.118:0/3702706505 2020-07-06T13:18:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dd4003e70 con 0x7f6de00a5140 2020-07-06T13:18:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3109021175 0 0) 0x7f6dd4003410 con 0x7f6de00a5140 2020-07-06T13:18:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc8002960 con 0 2020-07-06T13:18:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dcc001010 con 0x7f6de00a3390 2020-07-06T13:18:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (354463589 0 0) 0x7f6dcc001f70 con 0x7f6de00a3390 2020-07-06T13:18:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.791 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc8004620 con 0 2020-07-06T13:18:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3211609353 0 0) 0x7f6dd4003990 con 0x7f6de00a5140 2020-07-06T13:18:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6dc8002ee0 con 0 2020-07-06T13:18:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (690793374 0 0) 0x7f6dcc002410 con 0x7f6de00a3390 2020-07-06T13:18:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6dc8003540 con 0 2020-07-06T13:18:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (80976158 0 0) 0x7f6dcc0017c0 con 0x7f6de00a3390 2020-07-06T13:18:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 >> 172.21.15.118:6789/0 conn(0x7f6de00a5140 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-07-06T13:18:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de007ab60 con 0 2020-07-06T13:18:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6de694f700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de00712b0 con 0 2020-07-06T13:18:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6de694f700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de00a6b80 con 0 2020-07-06T13:18:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6dcc001310 con 0x7f6de00a3390 2020-07-06T13:18:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6dcc001a30 con 0x7f6de00a3390 2020-07-06T13:18:59.798 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f6dcc0034d0 con 0x7f6de00a3390 2020-07-06T13:18:59.798 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.795 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f6dcc003b20 con 0x7f6de00a3390 2020-07-06T13:18:59.801 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.803 7f6de694f700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de007af00 con 0 2020-07-06T13:18:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.803 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6de007af00 con 0x7f6de00a3390 2020-07-06T13:18:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f6de0156330 con 0 2020-07-06T13:18:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6dddffb700 1 -- 172.21.15.118:0/3702706505 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7f6dcc002fb0 con 0x7f6de00a3390 2020-07-06T13:18:59.891 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:18:59.892 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 >> 172.21.15.118:6800/9723 conn(0x7f6dc8006ed0 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-07-06T13:18:59.892 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 >> 172.21.15.118:6791/0 conn(0x7f6de00a3390 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-07-06T13:18:59.892 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 shutdown_connections 2020-07-06T13:18:59.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 shutdown_connections 2020-07-06T13:18:59.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 wait complete. 2020-07-06T13:18:59.893 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.891 7f6de694f700 1 -- 172.21.15.118:0/3702706505 >> 172.21.15.118:0/3702706505 conn(0x7f6de0099530 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:18:59.910 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-06T13:18:59.991 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.999 7f8313e42700 1 Processor -- start 2020-07-06T13:19:00.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:18:59.999 7f8313e42700 1 -- - start start 2020-07-06T13:19:00.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c14ba80 con 0 2020-07-06T13:19:00.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c14be20 con 0 2020-07-06T13:19:00.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8311e68700 1 -- 172.21.15.118:0/1634875005 learned_addr learned my addr 172.21.15.118:0/1634875005 2020-07-06T13:19:00.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82f4003630 con 0x7f830c148040 2020-07-06T13:19:00.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2540726856 0 0) 0x7f82f40039b0 con 0x7f830c148040 2020-07-06T13:19:00.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82ec002a20 con 0 2020-07-06T13:19:00.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82fc002620 con 0x7f830c14b340 2020-07-06T13:19:00.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3266856133 0 0) 0x7f82fc002920 con 0x7f830c14b340 2020-07-06T13:19:00.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82ec0046c0 con 0 2020-07-06T13:19:00.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (991951549 0 0) 0x7f82f4003f80 con 0x7f830c148040 2020-07-06T13:19:00.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 >> 172.21.15.118:6790/0 conn(0x7f830c14b340 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-07-06T13:19:00.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c07a910 con 0 2020-07-06T13:19:00.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f830c0e9f60 con 0x7f830c148040 2020-07-06T13:19:00.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8310e66700 1 -- 172.21.15.118:0/1634875005 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82f4001050 con 0x7f830c148040 2020-07-06T13:19:00.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- 172.21.15.118:0/1634875005 >> 172.21.15.118:6791/0 conn(0x7f830c148040 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-07-06T13:19:00.006 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- 172.21.15.118:0/1634875005 shutdown_connections 2020-07-06T13:19:00.006 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- 172.21.15.118:0/1634875005 shutdown_connections 2020-07-06T13:19:00.007 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- 172.21.15.118:0/1634875005 wait complete. 2020-07-06T13:19:00.007 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.003 7f8313e42700 1 -- 172.21.15.118:0/1634875005 >> 172.21.15.118:0/1634875005 conn(0x7f830c143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.007 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 Processor -- start 2020-07-06T13:19:00.007 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 -- - start start 2020-07-06T13:19:00.007 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c0a3e90 con 0 2020-07-06T13:19:00.008 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c0a53b0 con 0 2020-07-06T13:19:00.008 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8311e68700 1 -- 172.21.15.118:0/693974489 learned_addr learned my addr 172.21.15.118:0/693974489 2020-07-06T13:19:00.010 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82fc002e60 con 0x7f830c095ce0 2020-07-06T13:19:00.010 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82f4000e50 con 0x7f830c0a34a0 2020-07-06T13:19:00.011 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4034268855 0 0) 0x7f82fc002430 con 0x7f830c095ce0 2020-07-06T13:19:00.011 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82f0002df0 con 0 2020-07-06T13:19:00.011 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3166622516 0 0) 0x7f82f4001570 con 0x7f830c0a34a0 2020-07-06T13:19:00.011 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82f0004620 con 0 2020-07-06T13:19:00.011 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3645445786 0 0) 0x7f82fc0028e0 con 0x7f830c095ce0 2020-07-06T13:19:00.012 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82f0004df0 con 0 2020-07-06T13:19:00.012 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1191923772 0 0) 0x7f82f40018f0 con 0x7f830c0a34a0 2020-07-06T13:19:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82f00034b0 con 0 2020-07-06T13:19:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1051062503 0 0) 0x7f82fc001470 con 0x7f830c095ce0 2020-07-06T13:19:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 >> 172.21.15.118:6790/0 conn(0x7f830c0a34a0 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-07-06T13:19:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c07ab70 con 0 2020-07-06T13:19:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0712c0 con 0 2020-07-06T13:19:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f8313e42700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c0a6c90 con 0 2020-07-06T13:19:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f82fc000f70 con 0x7f830c095ce0 2020-07-06T13:19:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f82fc0018a0 con 0x7f830c095ce0 2020-07-06T13:19:00.015 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f82fc0031e0 con 0x7f830c095ce0 2020-07-06T13:19:00.015 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.007 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f82fc004ea0 con 0x7f830c095ce0 2020-07-06T13:19:00.015 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.015 7f8313e42700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4002050 con 0 2020-07-06T13:19:00.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.019 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f82fc001d90 con 0x7f830c095ce0 2020-07-06T13:19:00.108 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.107 7f8313e42700 1 -- 172.21.15.118:0/693974489 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f82e4001280 con 0 2020-07-06T13:19:00.108 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.107 7f830affd700 1 -- 172.21.15.118:0/693974489 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f82fc0039e0 con 0x7f830c095ce0 2020-07-06T13:19:00.109 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:00.110 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 >> 172.21.15.118:6800/9723 conn(0x7f82f00072a0 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-07-06T13:19:00.110 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 >> 172.21.15.118:6791/0 conn(0x7f830c095ce0 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-07-06T13:19:00.110 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 shutdown_connections 2020-07-06T13:19:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 shutdown_connections 2020-07-06T13:19:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 wait complete. 2020-07-06T13:19:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.111 7f8313e42700 1 -- 172.21.15.118:0/693974489 >> 172.21.15.118:0/693974489 conn(0x7f830c099640 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.119 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-07-06T13:19:00.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-07-06T13:19:00.120 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-07-06T13:19:00.205 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f81a19f4700 1 Processor -- start 2020-07-06T13:19:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f81a19f4700 1 -- - start start 2020-07-06T13:19:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f81a19f4700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c14ba90 con 0 2020-07-06T13:19:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f81a19f4700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c14be30 con 0 2020-07-06T13:19:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819b7fe700 1 -- 172.21.15.118:0/3481807816 learned_addr learned my addr 172.21.15.118:0/3481807816 2020-07-06T13:19:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f818c003630 con 0x7f819c148050 2020-07-06T13:19:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2401538278 0 0) 0x7f818c0039b0 con 0x7f819c148050 2020-07-06T13:19:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8188002a20 con 0 2020-07-06T13:19:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f81900022a0 con 0x7f819c14b350 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3989336594 0 0) 0x7f81900025a0 con 0x7f819c14b350 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.211 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f81880046c0 con 0 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1073512440 0 0) 0x7f818c003f80 con 0x7f819c148050 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 >> 172.21.15.118:6790/0 conn(0x7f819c14b350 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c07a7f0 con 0 2020-07-06T13:19:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f819c0e9f70 con 0x7f819c148050 2020-07-06T13:19:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f819a7fc700 1 -- 172.21.15.118:0/3481807816 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f818c001050 con 0x7f819c148050 2020-07-06T13:19:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f81a19f4700 1 -- 172.21.15.118:0/3481807816 >> 172.21.15.118:6791/0 conn(0x7f819c148050 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-07-06T13:19:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f81a19f4700 1 -- 172.21.15.118:0/3481807816 shutdown_connections 2020-07-06T13:19:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f81a19f4700 1 -- 172.21.15.118:0/3481807816 shutdown_connections 2020-07-06T13:19:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f81a19f4700 1 -- 172.21.15.118:0/3481807816 wait complete. 2020-07-06T13:19:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.215 7f81a19f4700 1 -- 172.21.15.118:0/3481807816 >> 172.21.15.118:0/3481807816 conn(0x7f819c143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 Processor -- start 2020-07-06T13:19:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 -- - start start 2020-07-06T13:19:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0a50f0 con 0 2020-07-06T13:19:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0a5350 con 0 2020-07-06T13:19:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f819b7fe700 1 -- 172.21.15.118:0/3355660320 learned_addr learned my addr 172.21.15.118:0/3355660320 2020-07-06T13:19:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f818c000e50 con 0x7f819c0a33c0 2020-07-06T13:19:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8190002ae0 con 0x7f819c095b90 2020-07-06T13:19:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1690946803 0 0) 0x7f818c003380 con 0x7f819c0a33c0 2020-07-06T13:19:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f817c002df0 con 0 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2791327504 0 0) 0x7f81900020e0 con 0x7f819c095b90 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f817c004620 con 0 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (207058600 0 0) 0x7f8190002470 con 0x7f819c095b90 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f817c004df0 con 0 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2559711316 0 0) 0x7f818c003750 con 0x7f819c0a33c0 2020-07-06T13:19:00.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f817c006570 con 0 2020-07-06T13:19:00.229 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2006490845 0 0) 0x7f81900010f0 con 0x7f819c095b90 2020-07-06T13:19:00.229 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 >> 172.21.15.118:6790/0 conn(0x7f819c0a33c0 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-07-06T13:19:00.229 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c07aa50 con 0 2020-07-06T13:19:00.229 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c0b2810 con 0 2020-07-06T13:19:00.229 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c18b6e0 con 0 2020-07-06T13:19:00.230 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f819c116e00 con 0x7f819c095b90 2020-07-06T13:19:00.230 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8190001520 con 0x7f819c095b90 2020-07-06T13:19:00.230 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f8190002ed0 con 0x7f819c095b90 2020-07-06T13:19:00.230 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.219 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f8190004800 con 0x7f819c095b90 2020-07-06T13:19:00.231 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.223 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8178002050 con 0 2020-07-06T13:19:00.231 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.231 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8190001760 con 0x7f819c095b90 2020-07-06T13:19:00.320 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.319 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8178001200 con 0 2020-07-06T13:19:00.321 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f8198ff9700 1 -- 172.21.15.118:0/3355660320 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+1888 (289213126 0 732431869) 0x7f8190001a20 con 0x7f819c095b90 2020-07-06T13:19:00.322 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:00.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 >> 172.21.15.118:6800/9723 conn(0x7f817c0072a0 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-07-06T13:19:00.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 >> 172.21.15.118:6789/0 conn(0x7f819c095b90 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-07-06T13:19:00.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 shutdown_connections 2020-07-06T13:19:00.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 shutdown_connections 2020-07-06T13:19:00.323 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 wait complete. 2020-07-06T13:19:00.324 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.323 7f81a19f4700 1 -- 172.21.15.118:0/3355660320 >> 172.21.15.118:0/3355660320 conn(0x7f819c0995a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.332 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"active_gid":4110,"active_name":"x","active_addr":"172.21.15.118:6800/9723","available":true,"standbys":[{"gid":4107,"name":"y","available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}],"services":{}} 2020-07-06T13:19:00.333 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-07-06T13:19:00.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-07-06T13:19:00.333 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:19:00.417 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.426 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b4bd18700 1 Processor -- start 2020-07-06T13:19:00.427 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b4bd18700 1 -- - start start 2020-07-06T13:19:00.428 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b4bd18700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4414bae0 con 0 2020-07-06T13:19:00.428 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b4bd18700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4414be80 con 0 2020-07-06T13:19:00.428 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b49d3e700 1 -- 172.21.15.118:0/2464248549 learned_addr learned my addr 172.21.15.118:0/2464248549 2020-07-06T13:19:00.429 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b400039b0 con 0x7f1b441480a0 2020-07-06T13:19:00.429 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (585861132 0 0) 0x7f1b40003d30 con 0x7f1b441480a0 2020-07-06T13:19:00.429 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1b28002a20 con 0 2020-07-06T13:19:00.429 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b340022a0 con 0x7f1b4414b3a0 2020-07-06T13:19:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3695362621 0 0) 0x7f1b340025a0 con 0x7f1b4414b3a0 2020-07-06T13:19:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1b280046c0 con 0 2020-07-06T13:19:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1944562730 0 0) 0x7f1b40004230 con 0x7f1b441480a0 2020-07-06T13:19:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 >> 172.21.15.118:6791/0 conn(0x7f1b4414b3a0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-07-06T13:19:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4407a840 con 0 2020-07-06T13:19:00.431 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1b440e9fc0 con 0x7f1b441480a0 2020-07-06T13:19:00.431 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b48d3c700 1 -- 172.21.15.118:0/2464248549 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b40001390 con 0x7f1b441480a0 2020-07-06T13:19:00.431 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.427 7f1b4bd18700 1 -- 172.21.15.118:0/2464248549 >> 172.21.15.118:6790/0 conn(0x7f1b441480a0 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-07-06T13:19:00.434 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- 172.21.15.118:0/2464248549 shutdown_connections 2020-07-06T13:19:00.435 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- 172.21.15.118:0/2464248549 shutdown_connections 2020-07-06T13:19:00.435 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- 172.21.15.118:0/2464248549 wait complete. 2020-07-06T13:19:00.435 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- 172.21.15.118:0/2464248549 >> 172.21.15.118:0/2464248549 conn(0x7f1b44143fd0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.435 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 Processor -- start 2020-07-06T13:19:00.436 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- - start start 2020-07-06T13:19:00.436 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b440a3cd0 con 0 2020-07-06T13:19:00.436 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b4bd18700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b440a6aa0 con 0 2020-07-06T13:19:00.436 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b49d3e700 1 -- 172.21.15.118:0/2700060437 learned_addr learned my addr 172.21.15.118:0/2700060437 2020-07-06T13:19:00.436 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b400011d0 con 0x7f1b440a32e0 2020-07-06T13:19:00.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b34002ae0 con 0x7f1b440a62f0 2020-07-06T13:19:00.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1025016550 0 0) 0x7f1b400018b0 con 0x7f1b440a32e0 2020-07-06T13:19:00.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1b2c002df0 con 0 2020-07-06T13:19:00.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (231729021 0 0) 0x7f1b340020e0 con 0x7f1b440a62f0 2020-07-06T13:19:00.437 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1b2c004620 con 0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (729580083 0 0) 0x7f1b40001da0 con 0x7f1b440a32e0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b2c004df0 con 0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3193383199 0 0) 0x7f1b34002470 con 0x7f1b440a62f0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.431 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b2c006570 con 0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3919367243 0 0) 0x7f1b340010f0 con 0x7f1b440a62f0 2020-07-06T13:19:00.438 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 >> 172.21.15.118:6790/0 conn(0x7f1b440a32e0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-07-06T13:19:00.439 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4407aaa0 con 0 2020-07-06T13:19:00.439 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b440b26a0 con 0 2020-07-06T13:19:00.439 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4418b1d0 con 0 2020-07-06T13:19:00.439 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1b34000bf0 con 0x7f1b440a62f0 2020-07-06T13:19:00.439 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1b34001520 con 0x7f1b440a62f0 2020-07-06T13:19:00.440 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f1b34002ed0 con 0x7f1b440a62f0 2020-07-06T13:19:00.440 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.435 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f1b340047b0 con 0x7f1b440a62f0 2020-07-06T13:19:00.441 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.443 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4407ae20 con 0 2020-07-06T13:19:00.445 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.447 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1b4407ae20 con 0x7f1b440a62f0 2020-07-06T13:19:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.539 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b44073140 con 0 2020-07-06T13:19:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.539 7f1b3affd700 1 -- 172.21.15.118:0/2700060437 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 3588361204) 0x7f1b34001760 con 0x7f1b440a62f0 2020-07-06T13:19:00.541 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:00.541 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:59.764319","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:19:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 >> 172.21.15.118:6800/9723 conn(0x7f1b2c0072a0 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-07-06T13:19:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 >> 172.21.15.118:6789/0 conn(0x7f1b440a62f0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-07-06T13:19:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 shutdown_connections 2020-07-06T13:19:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 shutdown_connections 2020-07-06T13:19:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 wait complete. 2020-07-06T13:19:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.543 7f1b4bd18700 1 -- 172.21.15.118:0/2700060437 >> 172.21.15.118:0/2700060437 conn(0x7f1b440993f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.552 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-07-06T13:19:00.552 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:19:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.640 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.639 7fbe24742700 1 Processor -- start 2020-07-06T13:19:00.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.639 7fbe24742700 1 -- - start start 2020-07-06T13:19:00.641 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c14ba90 con 0 2020-07-06T13:19:00.642 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c14be30 con 0 2020-07-06T13:19:00.642 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe22768700 1 -- 172.21.15.118:0/3024291519 learned_addr learned my addr 172.21.15.118:0/3024291519 2020-07-06T13:19:00.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe18003630 con 0x7fbe1c148050 2020-07-06T13:19:00.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1584683639 0 0) 0x7fbe180039b0 con 0x7fbe1c148050 2020-07-06T13:19:00.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbe04002a20 con 0 2020-07-06T13:19:00.644 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe0c0022a0 con 0x7fbe1c14b350 2020-07-06T13:19:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1836003615 0 0) 0x7fbe0c0025a0 con 0x7fbe1c14b350 2020-07-06T13:19:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbe040046c0 con 0 2020-07-06T13:19:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2861365366 0 0) 0x7fbe18003f80 con 0x7fbe1c148050 2020-07-06T13:19:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 >> 172.21.15.118:6790/0 conn(0x7fbe1c14b350 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-07-06T13:19:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c07a7f0 con 0 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbe1c0e9f70 con 0x7fbe1c148050 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe21766700 1 -- 172.21.15.118:0/3024291519 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe18001050 con 0x7fbe1c148050 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- 172.21.15.118:0/3024291519 >> 172.21.15.118:6791/0 conn(0x7fbe1c148050 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- 172.21.15.118:0/3024291519 shutdown_connections 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- 172.21.15.118:0/3024291519 shutdown_connections 2020-07-06T13:19:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- 172.21.15.118:0/3024291519 wait complete. 2020-07-06T13:19:00.647 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.643 7fbe24742700 1 -- 172.21.15.118:0/3024291519 >> 172.21.15.118:0/3024291519 conn(0x7fbe1c143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.657 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 Processor -- start 2020-07-06T13:19:00.657 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 -- - start start 2020-07-06T13:19:00.657 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0a3b00 con 0 2020-07-06T13:19:00.657 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0a6770 con 0 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe22768700 1 -- 172.21.15.118:0/626252674 learned_addr learned my addr 172.21.15.118:0/626252674 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe0c002ae0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1876539805 0 0) 0x7fbe0c0020e0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbdfc002960 con 0 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe18000e50 con 0x7fbe1c0a3110 2020-07-06T13:19:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2819989128 0 0) 0x7fbe18003380 con 0x7fbe1c0a3110 2020-07-06T13:19:00.659 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbdfc004620 con 0 2020-07-06T13:19:00.659 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2979554148 0 0) 0x7fbe0c002600 con 0x7fbe1c0a6120 2020-07-06T13:19:00.659 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbdfc002ee0 con 0 2020-07-06T13:19:00.659 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3748027867 0 0) 0x7fbe18003700 con 0x7fbe1c0a3110 2020-07-06T13:19:00.659 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbdfc003540 con 0 2020-07-06T13:19:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (846735730 0 0) 0x7fbe0c0010f0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 >> 172.21.15.118:6789/0 conn(0x7fbe1c0a3110 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-07-06T13:19:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c07aa50 con 0 2020-07-06T13:19:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c0b2510 con 0 2020-07-06T13:19:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe24742700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c18af80 con 0 2020-07-06T13:19:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbe0c000bf0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.647 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fbe0c001520 con 0x7fbe1c0a6120 2020-07-06T13:19:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.651 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fbe0c001970 con 0x7fbe1c0a6120 2020-07-06T13:19:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.651 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fbe0c004b50 con 0x7fbe1c0a6120 2020-07-06T13:19:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.655 7fbe24742700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c07add0 con 0 2020-07-06T13:19:00.662 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.659 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fbe1c07add0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.745 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.743 7fbe24742700 1 -- 172.21.15.118:0/626252674 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe1c18b780 con 0 2020-07-06T13:19:00.745 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe0b7fe700 1 -- 172.21.15.118:0/626252674 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 3588361204) 0x7fbe0c0035e0 con 0x7fbe1c0a6120 2020-07-06T13:19:00.746 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:00.746 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:59.764319","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:19:00.747 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 >> 172.21.15.118:6800/9723 conn(0x7fbdfc006e70 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-07-06T13:19:00.747 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 >> 172.21.15.118:6791/0 conn(0x7fbe1c0a6120 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-07-06T13:19:00.747 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 shutdown_connections 2020-07-06T13:19:00.747 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 shutdown_connections 2020-07-06T13:19:00.748 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 wait complete. 2020-07-06T13:19:00.748 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.747 7fbe24742700 1 -- 172.21.15.118:0/626252674 >> 172.21.15.118:0/626252674 conn(0x7fbe1c099240 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.760 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-07-06T13:19:00.839 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.845 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.843 7fa33d158700 1 Processor -- start 2020-07-06T13:19:00.845 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.843 7fa33d158700 1 -- - start start 2020-07-06T13:19:00.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33814ba60 con 0 2020-07-06T13:19:00.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33814be00 con 0 2020-07-06T13:19:00.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336826700 1 -- 172.21.15.118:0/1512293912 learned_addr learned my addr 172.21.15.118:0/1512293912 2020-07-06T13:19:00.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa328002220 con 0x7fa338148020 2020-07-06T13:19:00.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1359449336 0 0) 0x7fa3280025a0 con 0x7fa338148020 2020-07-06T13:19:00.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa324002a20 con 0 2020-07-06T13:19:00.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa32c003630 con 0x7fa33814b320 2020-07-06T13:19:00.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3083630472 0 0) 0x7fa32c003930 con 0x7fa33814b320 2020-07-06T13:19:00.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa3240046c0 con 0 2020-07-06T13:19:00.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1739826077 0 0) 0x7fa32c003dd0 con 0x7fa33814b320 2020-07-06T13:19:00.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 >> 172.21.15.118:6789/0 conn(0x7fa338148020 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-07-06T13:19:00.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33807a7e0 con 0 2020-07-06T13:19:00.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa338116dd0 con 0x7fa33814b320 2020-07-06T13:19:00.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa336025700 1 -- 172.21.15.118:0/1512293912 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa32c000e50 con 0x7fa33814b320 2020-07-06T13:19:00.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- 172.21.15.118:0/1512293912 >> 172.21.15.118:6790/0 conn(0x7fa33814b320 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-07-06T13:19:00.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- 172.21.15.118:0/1512293912 shutdown_connections 2020-07-06T13:19:00.850 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- 172.21.15.118:0/1512293912 shutdown_connections 2020-07-06T13:19:00.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- 172.21.15.118:0/1512293912 wait complete. 2020-07-06T13:19:00.851 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.847 7fa33d158700 1 -- 172.21.15.118:0/1512293912 >> 172.21.15.118:0/1512293912 conn(0x7fa338143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 Processor -- start 2020-07-06T13:19:00.853 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 -- - start start 2020-07-06T13:19:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380a3ba0 con 0 2020-07-06T13:19:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380a6970 con 0 2020-07-06T13:19:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa336826700 1 -- 172.21.15.118:0/2307028820 learned_addr learned my addr 172.21.15.118:0/2307028820 2020-07-06T13:19:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa328002bc0 con 0x7fa3380a31b0 2020-07-06T13:19:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa32c003dd0 con 0x7fa3380a61c0 2020-07-06T13:19:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1422070113 0 0) 0x7fa3280020f0 con 0x7fa3380a31b0 2020-07-06T13:19:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa318002df0 con 0 2020-07-06T13:19:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3135115848 0 0) 0x7fa32c003410 con 0x7fa3380a61c0 2020-07-06T13:19:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa318004620 con 0 2020-07-06T13:19:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1727994277 0 0) 0x7fa3280025e0 con 0x7fa3380a31b0 2020-07-06T13:19:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa318004df0 con 0 2020-07-06T13:19:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2127447294 0 0) 0x7fa32c003680 con 0x7fa3380a61c0 2020-07-06T13:19:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3180065f0 con 0 2020-07-06T13:19:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3120149107 0 0) 0x7fa32c001610 con 0x7fa3380a61c0 2020-07-06T13:19:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 >> 172.21.15.118:6789/0 conn(0x7fa3380a31b0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-07-06T13:19:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33807aa40 con 0 2020-07-06T13:19:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338071220 con 0 2020-07-06T13:19:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa33d158700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33818b110 con 0 2020-07-06T13:19:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa32c001160 con 0x7fa3380a61c0 2020-07-06T13:19:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fa32c001a40 con 0x7fa3380a61c0 2020-07-06T13:19:00.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fa32c0046d0 con 0x7fa3380a61c0 2020-07-06T13:19:00.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.851 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fa32c005e20 con 0x7fa3380a61c0 2020-07-06T13:19:00.858 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.859 7fa33d158700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6809/10099 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa314004d40 con 0 2020-07-06T13:19:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.859 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== osd.0 172.21.15.118:6809/10099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7fa330000f70 con 0x7fa3140015e0 2020-07-06T13:19:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 --> 172.21.15.118:6809/10099 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3140053d0 con 0 2020-07-06T13:19:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa334822700 1 -- 172.21.15.118:0/2307028820 <== osd.0 172.21.15.118:6809/10099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7fa314004d40 con 0x7fa3140015e0 2020-07-06T13:19:00.870 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:00.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 >> 172.21.15.118:6809/10099 conn(0x7fa3140015e0 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-07-06T13:19:00.871 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 >> 172.21.15.118:6800/9723 conn(0x7fa318007320 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-07-06T13:19:00.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 >> 172.21.15.118:6790/0 conn(0x7fa3380a61c0 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-07-06T13:19:00.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 shutdown_connections 2020-07-06T13:19:00.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 shutdown_connections 2020-07-06T13:19:00.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 wait complete. 2020-07-06T13:19:00.872 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.871 7fa33d158700 1 -- 172.21.15.118:0/2307028820 >> 172.21.15.118:0/2307028820 conn(0x7fa3380993d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.881 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-07-06T13:19:00.967 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:00.977 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.975 7f4d986e9700 1 Processor -- start 2020-07-06T13:19:00.977 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.975 7f4d986e9700 1 -- - start start 2020-07-06T13:19:00.977 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.975 7f4d986e9700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9014ba60 con 0 2020-07-06T13:19:00.977 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.975 7f4d986e9700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9014be00 con 0 2020-07-06T13:19:00.978 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.975 7f4d9670f700 1 -- 172.21.15.118:0/332108764 learned_addr learned my addr 172.21.15.118:0/332108764 2020-07-06T13:19:00.979 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d800022a0 con 0x7f4d9014b320 2020-07-06T13:19:00.979 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2376699958 0 0) 0x7f4d80002620 con 0x7f4d9014b320 2020-07-06T13:19:00.980 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d78002a20 con 0 2020-07-06T13:19:00.980 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d8c0039b0 con 0x7f4d90148020 2020-07-06T13:19:00.980 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4150560036 0 0) 0x7f4d8c003cb0 con 0x7f4d90148020 2020-07-06T13:19:00.980 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d780046c0 con 0 2020-07-06T13:19:00.980 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (360975816 0 0) 0x7f4d80002bf0 con 0x7f4d9014b320 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 >> 172.21.15.118:6790/0 conn(0x7f4d90148020 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9007a7e0 con 0 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4d90116dd0 con 0x7f4d9014b320 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d9570d700 1 -- 172.21.15.118:0/332108764 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d80001050 con 0x7f4d9014b320 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- 172.21.15.118:0/332108764 >> 172.21.15.118:6791/0 conn(0x7f4d9014b320 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-07-06T13:19:00.981 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- 172.21.15.118:0/332108764 shutdown_connections 2020-07-06T13:19:00.982 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- 172.21.15.118:0/332108764 shutdown_connections 2020-07-06T13:19:00.982 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- 172.21.15.118:0/332108764 wait complete. 2020-07-06T13:19:00.982 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- 172.21.15.118:0/332108764 >> 172.21.15.118:0/332108764 conn(0x7f4d90143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:00.985 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 Processor -- start 2020-07-06T13:19:00.985 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.979 7f4d986e9700 1 -- - start start 2020-07-06T13:19:00.985 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d986e9700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900a3c30 con 0 2020-07-06T13:19:00.985 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d986e9700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d90095ca0 con 0 2020-07-06T13:19:00.985 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d9670f700 1 -- 172.21.15.118:0/1772890250 learned_addr learned my addr 172.21.15.118:0/1772890250 2020-07-06T13:19:00.986 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d8c0042e0 con 0x7f4d900a3240 2020-07-06T13:19:00.986 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (118615295 0 0) 0x7f4d8c003840 con 0x7f4d900a3240 2020-07-06T13:19:00.986 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d70002960 con 0 2020-07-06T13:19:00.986 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d80000e50 con 0x7f4d900a4ff0 2020-07-06T13:19:00.986 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2172590293 0 0) 0x7f4d80001ff0 con 0x7f4d900a4ff0 2020-07-06T13:19:00.987 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d70004620 con 0 2020-07-06T13:19:00.987 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2953313878 0 0) 0x7f4d8c0011d0 con 0x7f4d900a3240 2020-07-06T13:19:00.987 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d70002ee0 con 0 2020-07-06T13:19:00.987 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (515184929 0 0) 0x7f4d800023c0 con 0x7f4d900a4ff0 2020-07-06T13:19:00.987 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d70003540 con 0 2020-07-06T13:19:00.988 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2485177205 0 0) 0x7f4d80002720 con 0x7f4d900a4ff0 2020-07-06T13:19:00.988 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 >> 172.21.15.118:6791/0 conn(0x7f4d900a3240 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-07-06T13:19:00.989 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9007aa40 con 0 2020-07-06T13:19:00.989 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d90072b10 con 0 2020-07-06T13:19:00.989 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d900a6a70 con 0 2020-07-06T13:19:00.989 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4d80001360 con 0x7f4d900a4ff0 2020-07-06T13:19:00.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4d800019d0 con 0x7f4d900a4ff0 2020-07-06T13:19:00.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f4d80001c10 con 0x7f4d900a4ff0 2020-07-06T13:19:00.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.983 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f4d80004a40 con 0x7f4d900a4ff0 2020-07-06T13:19:00.990 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.991 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6801/10089 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d6c004d40 con 0 2020-07-06T13:19:00.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:00.991 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== osd.1 172.21.15.118:6801/10089 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f4d900bd100 con 0x7f4d6c0015e0 2020-07-06T13:19:01.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 --> 172.21.15.118:6801/10089 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d6c0053c0 con 0 2020-07-06T13:19:01.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d7f7fe700 1 -- 172.21.15.118:0/1772890250 <== osd.1 172.21.15.118:6801/10089 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f4d6c004d40 con 0x7f4d6c0015e0 2020-07-06T13:19:01.003 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:01.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 >> 172.21.15.118:6801/10089 conn(0x7f4d6c0015e0 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-07-06T13:19:01.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 >> 172.21.15.118:6800/9723 conn(0x7f4d70006e70 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-07-06T13:19:01.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 >> 172.21.15.118:6790/0 conn(0x7f4d900a4ff0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-07-06T13:19:01.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 shutdown_connections 2020-07-06T13:19:01.006 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 shutdown_connections 2020-07-06T13:19:01.006 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 wait complete. 2020-07-06T13:19:01.006 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.003 7f4d986e9700 1 -- 172.21.15.118:0/1772890250 >> 172.21.15.118:0/1772890250 conn(0x7f4d90099470 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.015 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-07-06T13:19:01.111 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f037aa32700 1 Processor -- start 2020-07-06T13:19:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f037aa32700 1 -- - start start 2020-07-06T13:19:01.118 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f037aa32700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037414ba60 con 0 2020-07-06T13:19:01.118 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f037aa32700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037414be00 con 0 2020-07-06T13:19:01.120 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f0378a58700 1 -- 172.21.15.118:0/1721639311 learned_addr learned my addr 172.21.15.118:0/1721639311 2020-07-06T13:19:01.120 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f03600022a0 con 0x7f037414b320 2020-07-06T13:19:01.120 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3008304365 0 0) 0x7f0360002620 con 0x7f037414b320 2020-07-06T13:19:01.120 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0358002a20 con 0 2020-07-06T13:19:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0368003630 con 0x7f0374148020 2020-07-06T13:19:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2889636338 0 0) 0x7f0368003930 con 0x7f0374148020 2020-07-06T13:19:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f03580046c0 con 0 2020-07-06T13:19:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4081473064 0 0) 0x7f0360002bf0 con 0x7f037414b320 2020-07-06T13:19:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 >> 172.21.15.118:6790/0 conn(0x7f0374148020 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-07-06T13:19:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037407a7e0 con 0 2020-07-06T13:19:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0374116dd0 con 0x7f037414b320 2020-07-06T13:19:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f03737fe700 1 -- 172.21.15.118:0/1721639311 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0360001050 con 0x7f037414b320 2020-07-06T13:19:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.119 7f037aa32700 1 -- 172.21.15.118:0/1721639311 >> 172.21.15.118:6791/0 conn(0x7f037414b320 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-07-06T13:19:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- 172.21.15.118:0/1721639311 shutdown_connections 2020-07-06T13:19:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- 172.21.15.118:0/1721639311 shutdown_connections 2020-07-06T13:19:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- 172.21.15.118:0/1721639311 wait complete. 2020-07-06T13:19:01.124 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- 172.21.15.118:0/1721639311 >> 172.21.15.118:0/1721639311 conn(0x7f0374143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 Processor -- start 2020-07-06T13:19:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- - start start 2020-07-06T13:19:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740a3ce0 con 0 2020-07-06T13:19:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f037aa32700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740a3450 con 0 2020-07-06T13:19:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f0378a58700 1 -- 172.21.15.118:0/2056666964 learned_addr learned my addr 172.21.15.118:0/2056666964 2020-07-06T13:19:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0368003f60 con 0x7f0374095bf0 2020-07-06T13:19:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3627471636 0 0) 0x7f0368003470 con 0x7f0374095bf0 2020-07-06T13:19:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f035c002960 con 0 2020-07-06T13:19:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.123 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0360000e50 con 0x7f03740a50a0 2020-07-06T13:19:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3103447291 0 0) 0x7f0360001ff0 con 0x7f03740a50a0 2020-07-06T13:19:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f035c004620 con 0 2020-07-06T13:19:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1065327450 0 0) 0x7f0368000e50 con 0x7f0374095bf0 2020-07-06T13:19:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f035c002ee0 con 0 2020-07-06T13:19:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (151593766 0 0) 0x7f0360002370 con 0x7f03740a50a0 2020-07-06T13:19:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f035c003540 con 0 2020-07-06T13:19:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1127077162 0 0) 0x7f0368001360 con 0x7f0374095bf0 2020-07-06T13:19:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 >> 172.21.15.118:6789/0 conn(0x7f03740a50a0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-07-06T13:19:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037407aa40 con 0 2020-07-06T13:19:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f037aa32700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0374071220 con 0 2020-07-06T13:19:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f037aa32700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03740a6a90 con 0 2020-07-06T13:19:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0368000bf0 con 0x7f0374095bf0 2020-07-06T13:19:01.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f03680017e0 con 0x7f0374095bf0 2020-07-06T13:19:01.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f0368001a20 con 0x7f0374095bf0 2020-07-06T13:19:01.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.127 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f0368006000 con 0x7f0374095bf0 2020-07-06T13:19:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.131 7f037aa32700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6805/10088 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03741487b0 con 0 2020-07-06T13:19:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.131 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== osd.2 172.21.15.118:6805/10088 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f03740bd100 con 0x7f0374034240 2020-07-06T13:19:01.143 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.143 7f037aa32700 1 -- 172.21.15.118:0/2056666964 --> 172.21.15.118:6805/10088 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f037407ada0 con 0 2020-07-06T13:19:01.144 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.143 7f0371ffb700 1 -- 172.21.15.118:0/2056666964 <== osd.2 172.21.15.118:6805/10088 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f03741487b0 con 0x7f0374034240 2020-07-06T13:19:01.144 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:01.145 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.143 7f037aa32700 1 -- 172.21.15.118:0/2056666964 >> 172.21.15.118:6805/10088 conn(0x7f0374034240 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-07-06T13:19:01.145 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.143 7f037aa32700 1 -- 172.21.15.118:0/2056666964 >> 172.21.15.118:6800/9723 conn(0x7f035c006ed0 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-07-06T13:19:01.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.147 7f037aa32700 1 -- 172.21.15.118:0/2056666964 >> 172.21.15.118:6791/0 conn(0x7f0374095bf0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-07-06T13:19:01.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.147 7f037aa32700 1 -- 172.21.15.118:0/2056666964 shutdown_connections 2020-07-06T13:19:01.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.147 7f037aa32700 1 -- 172.21.15.118:0/2056666964 shutdown_connections 2020-07-06T13:19:01.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.147 7f037aa32700 1 -- 172.21.15.118:0/2056666964 wait complete. 2020-07-06T13:19:01.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.147 7f037aa32700 1 -- 172.21.15.118:0/2056666964 >> 172.21.15.118:0/2056666964 conn(0x7f0374099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.159 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-07-06T13:19:01.246 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.251 7f3a5b027700 1 Processor -- start 2020-07-06T13:19:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.251 7f3a5b027700 1 -- - start start 2020-07-06T13:19:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5414ba60 con 0 2020-07-06T13:19:01.254 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5414be00 con 0 2020-07-06T13:19:01.254 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5884c700 1 -- 172.21.15.118:0/953925363 learned_addr learned my addr 172.21.15.118:0/953925363 2020-07-06T13:19:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a500022a0 con 0x7f3a54148020 2020-07-06T13:19:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a48003630 con 0x7f3a5414b320 2020-07-06T13:19:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (102910796 0 0) 0x7f3a50002620 con 0x7f3a54148020 2020-07-06T13:19:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3a38002ea0 con 0 2020-07-06T13:19:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3099082271 0 0) 0x7f3a480039b0 con 0x7f3a5414b320 2020-07-06T13:19:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3a380046b0 con 0 2020-07-06T13:19:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (972861390 0 0) 0x7f3a48003e50 con 0x7f3a5414b320 2020-07-06T13:19:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 >> 172.21.15.118:6791/0 conn(0x7f3a54148020 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-07-06T13:19:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5407a7e0 con 0 2020-07-06T13:19:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3a48000bf0 con 0x7f3a5414b320 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a47fff700 1 -- 172.21.15.118:0/953925363 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a48001010 con 0x7f3a5414b320 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- 172.21.15.118:0/953925363 >> 172.21.15.118:6790/0 conn(0x7f3a5414b320 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- 172.21.15.118:0/953925363 shutdown_connections 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- 172.21.15.118:0/953925363 shutdown_connections 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- 172.21.15.118:0/953925363 wait complete. 2020-07-06T13:19:01.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.255 7f3a5b027700 1 -- 172.21.15.118:0/953925363 >> 172.21.15.118:0/953925363 conn(0x7f3a54143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.260 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5b027700 1 Processor -- start 2020-07-06T13:19:01.260 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5b027700 1 -- - start start 2020-07-06T13:19:01.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5b027700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a540a3dc0 con 0 2020-07-06T13:19:01.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5b027700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a54092a80 con 0 2020-07-06T13:19:01.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5904d700 1 -- 172.21.15.118:0/3133567618 learned_addr learned my addr 172.21.15.118:0/3133567618 2020-07-06T13:19:01.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a48003e50 con 0x7f3a540a5180 2020-07-06T13:19:01.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a500020e0 con 0x7f3a540a33d0 2020-07-06T13:19:01.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (75428835 0 0) 0x7f3a48000e50 con 0x7f3a540a5180 2020-07-06T13:19:01.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3a3c002df0 con 0 2020-07-06T13:19:01.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2269940882 0 0) 0x7f3a500023a0 con 0x7f3a540a33d0 2020-07-06T13:19:01.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3a3c004620 con 0 2020-07-06T13:19:01.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (463232844 0 0) 0x7f3a50000e50 con 0x7f3a540a33d0 2020-07-06T13:19:01.263 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a3c004df0 con 0 2020-07-06T13:19:01.263 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4058841623 0 0) 0x7f3a48003560 con 0x7f3a540a5180 2020-07-06T13:19:01.263 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a3c0034b0 con 0 2020-07-06T13:19:01.263 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1220908300 0 0) 0x7f3a50001360 con 0x7f3a540a33d0 2020-07-06T13:19:01.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 >> 172.21.15.118:6791/0 conn(0x7f3a540a5180 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-07-06T13:19:01.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5407aa40 con 0 2020-07-06T13:19:01.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3a540e9f40 con 0x7f3a540a33d0 2020-07-06T13:19:01.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f3a50001790 con 0x7f3a540a33d0 2020-07-06T13:19:01.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.259 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a54071300 con 0 2020-07-06T13:19:01.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.263 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a540a6ca0 con 0 2020-07-06T13:19:01.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.263 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f3a500044b0 con 0x7f3a540a33d0 2020-07-06T13:19:01.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.263 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f3a50004790 con 0x7f3a540a33d0 2020-07-06T13:19:01.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.267 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6813/10110 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a541487b0 con 0 2020-07-06T13:19:01.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.267 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== osd.3 172.21.15.118:6813/10110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f3a4c000f70 con 0x7f3a54034240 2020-07-06T13:19:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 --> 172.21.15.118:6813/10110 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a5407ada0 con 0 2020-07-06T13:19:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a467fc700 1 -- 172.21.15.118:0/3133567618 <== osd.3 172.21.15.118:6813/10110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f3a541487b0 con 0x7f3a54034240 2020-07-06T13:19:01.278 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 >> 172.21.15.118:6813/10110 conn(0x7f3a54034240 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-07-06T13:19:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 >> 172.21.15.118:6800/9723 conn(0x7f3a3c0072a0 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-07-06T13:19:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 >> 172.21.15.118:6789/0 conn(0x7f3a540a33d0 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-07-06T13:19:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 shutdown_connections 2020-07-06T13:19:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 shutdown_connections 2020-07-06T13:19:01.281 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 wait complete. 2020-07-06T13:19:01.281 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.279 7f3a5b027700 1 -- 172.21.15.118:0/3133567618 >> 172.21.15.118:0/3133567618 conn(0x7f3a54099670 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.294 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-07-06T13:19:01.379 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:01.385 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 Processor -- start 2020-07-06T13:19:01.385 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 -- - start start 2020-07-06T13:19:01.386 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9414ba60 con 0 2020-07-06T13:19:01.386 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9414be00 con 0 2020-07-06T13:19:01.387 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99a65700 1 -- 172.21.15.118:0/2501212571 learned_addr learned my addr 172.21.15.118:0/2501212571 2020-07-06T13:19:01.387 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa900022a0 con 0x7faa94148020 2020-07-06T13:19:01.388 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3636003880 0 0) 0x7faa90002620 con 0x7faa94148020 2020-07-06T13:19:01.388 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faa7c002a20 con 0 2020-07-06T13:19:01.388 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa84003630 con 0x7faa9414b320 2020-07-06T13:19:01.388 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (325736851 0 0) 0x7faa84003930 con 0x7faa9414b320 2020-07-06T13:19:01.388 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faa7c0046c0 con 0 2020-07-06T13:19:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3301011187 0 0) 0x7faa90002bf0 con 0x7faa94148020 2020-07-06T13:19:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 >> 172.21.15.118:6790/0 conn(0x7faa9414b320 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-07-06T13:19:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9407a7e0 con 0 2020-07-06T13:19:01.390 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7faa940e9f40 con 0x7faa94148020 2020-07-06T13:19:01.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa99264700 1 -- 172.21.15.118:0/2501212571 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa90001050 con 0x7faa94148020 2020-07-06T13:19:01.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 -- 172.21.15.118:0/2501212571 >> 172.21.15.118:6791/0 conn(0x7faa94148020 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-07-06T13:19:01.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.387 7faa9c240700 1 -- 172.21.15.118:0/2501212571 shutdown_connections 2020-07-06T13:19:01.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- 172.21.15.118:0/2501212571 shutdown_connections 2020-07-06T13:19:01.391 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- 172.21.15.118:0/2501212571 wait complete. 2020-07-06T13:19:01.392 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- 172.21.15.118:0/2501212571 >> 172.21.15.118:0/2501212571 conn(0x7faa94143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.394 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 Processor -- start 2020-07-06T13:19:01.394 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- - start start 2020-07-06T13:19:01.394 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa940a3be0 con 0 2020-07-06T13:19:01.394 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9c240700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa940a69b0 con 0 2020-07-06T13:19:01.395 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.391 7faa9a266700 1 -- 172.21.15.118:0/1119823735 learned_addr learned my addr 172.21.15.118:0/1119823735 2020-07-06T13:19:01.395 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa84003e70 con 0x7faa940a6200 2020-07-06T13:19:01.395 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3535088028 0 0) 0x7faa84003470 con 0x7faa940a6200 2020-07-06T13:19:01.395 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faa74002960 con 0 2020-07-06T13:19:01.395 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa90001010 con 0x7faa940a31f0 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3451144151 0 0) 0x7faa90001ff0 con 0x7faa940a31f0 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faa74004620 con 0 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (279485087 0 0) 0x7faa84003990 con 0x7faa940a6200 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa74002ee0 con 0 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (71831579 0 0) 0x7faa90002380 con 0x7faa940a31f0 2020-07-06T13:19:01.396 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa74003540 con 0 2020-07-06T13:19:01.397 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3818512097 0 0) 0x7faa840010f0 con 0x7faa940a6200 2020-07-06T13:19:01.397 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 >> 172.21.15.118:6791/0 conn(0x7faa940a31f0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-07-06T13:19:01.397 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9407aa40 con 0 2020-07-06T13:19:01.397 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa9c240700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa94071220 con 0 2020-07-06T13:19:01.398 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa9c240700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9418b150 con 0 2020-07-06T13:19:01.398 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7faa94116dd0 con 0x7faa940a6200 2020-07-06T13:19:01.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7faa84001520 con 0x7faa940a6200 2020-07-06T13:19:01.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7faa84001970 con 0x7faa940a6200 2020-07-06T13:19:01.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.395 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7faa84004f80 con 0x7faa940a6200 2020-07-06T13:19:01.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.399 7faa9c240700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9407ada0 con 0 2020-07-06T13:19:01.403 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.403 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7faa9407ada0 con 0x7faa940a6200 2020-07-06T13:19:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.495 7faa9c240700 1 -- 172.21.15.118:0/1119823735 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa94156320 con 0 2020-07-06T13:19:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.495 7faa837fe700 1 -- 172.21.15.118:0/1119823735 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (574334944 0 3050755158) 0x7faa840048c0 con 0x7faa940a6200 2020-07-06T13:19:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:38654705668 2020-07-06T13:19:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 >> 172.21.15.118:6800/9723 conn(0x7faa74006e70 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-07-06T13:19:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 >> 172.21.15.118:6790/0 conn(0x7faa940a6200 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-07-06T13:19:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 shutdown_connections 2020-07-06T13:19:01.498 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 shutdown_connections 2020-07-06T13:19:01.498 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 wait complete. 2020-07-06T13:19:01.498 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:01.499 7faa9c240700 1 -- 172.21.15.118:0/1119823735 >> 172.21.15.118:0/1119823735 conn(0x7faa94099580 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:01.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2020-07-06T13:19:02.510 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-07-06T13:19:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4069445700 1 Processor -- start 2020-07-06T13:19:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4069445700 1 -- - start start 2020-07-06T13:19:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4069445700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406414ba50 con 0 2020-07-06T13:19:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4069445700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406414bdf0 con 0 2020-07-06T13:19:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4063269700 1 -- 172.21.15.118:0/1696484740 learned_addr learned my addr 172.21.15.118:0/1696484740 2020-07-06T13:19:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4054003630 con 0x7f4064148010 2020-07-06T13:19:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2966926297 0 0) 0x7f40540039b0 con 0x7f4064148010 2020-07-06T13:19:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4050002a20 con 0 2020-07-06T13:19:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f40580022a0 con 0x7f406414b310 2020-07-06T13:19:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3294451345 0 0) 0x7f40580025a0 con 0x7f406414b310 2020-07-06T13:19:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f40500046c0 con 0 2020-07-06T13:19:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1058768765 0 0) 0x7f4054003f80 con 0x7f4064148010 2020-07-06T13:19:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 >> 172.21.15.118:6789/0 conn(0x7f406414b310 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-07-06T13:19:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406407a7d0 con 0 2020-07-06T13:19:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f40640e9f30 con 0x7f4064148010 2020-07-06T13:19:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4062267700 1 -- 172.21.15.118:0/1696484740 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4054001050 con 0x7f4064148010 2020-07-06T13:19:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.615 7f4069445700 1 -- 172.21.15.118:0/1696484740 >> 172.21.15.118:6790/0 conn(0x7f4064148010 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-07-06T13:19:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- 172.21.15.118:0/1696484740 shutdown_connections 2020-07-06T13:19:02.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- 172.21.15.118:0/1696484740 shutdown_connections 2020-07-06T13:19:02.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- 172.21.15.118:0/1696484740 wait complete. 2020-07-06T13:19:02.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- 172.21.15.118:0/1696484740 >> 172.21.15.118:0/1696484740 conn(0x7f4064143f40 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:02.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 Processor -- start 2020-07-06T13:19:02.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- - start start 2020-07-06T13:19:02.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640a3bb0 con 0 2020-07-06T13:19:02.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4069445700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640a6980 con 0 2020-07-06T13:19:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.619 7f4063269700 1 -- 172.21.15.118:0/3529175626 learned_addr learned my addr 172.21.15.118:0/3529175626 2020-07-06T13:19:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4054000e50 con 0x7f40640a31c0 2020-07-06T13:19:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3198088829 0 0) 0x7f4054001570 con 0x7f40640a31c0 2020-07-06T13:19:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4044002960 con 0 2020-07-06T13:19:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4058002ae0 con 0x7f40640a61d0 2020-07-06T13:19:02.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2444764367 0 0) 0x7f40580020b0 con 0x7f40640a61d0 2020-07-06T13:19:02.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4044004620 con 0 2020-07-06T13:19:02.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2792366991 0 0) 0x7f40540019c0 con 0x7f40640a31c0 2020-07-06T13:19:02.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4044002ee0 con 0 2020-07-06T13:19:02.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1087716458 0 0) 0x7f4058002510 con 0x7f40640a61d0 2020-07-06T13:19:02.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4044003540 con 0 2020-07-06T13:19:02.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4202374313 0 0) 0x7f4054003620 con 0x7f40640a31c0 2020-07-06T13:19:02.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 >> 172.21.15.118:6789/0 conn(0x7f40640a61d0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-07-06T13:19:02.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406407aa30 con 0 2020-07-06T13:19:02.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4069445700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4064071210 con 0 2020-07-06T13:19:02.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4069445700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f406418b120 con 0 2020-07-06T13:19:02.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4054000bf0 con 0x7f40640a31c0 2020-07-06T13:19:02.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f4054003a50 con 0x7f40640a31c0 2020-07-06T13:19:02.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f4054004780 con 0x7f40640a31c0 2020-07-06T13:19:02.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.623 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f4054005170 con 0x7f40640a31c0 2020-07-06T13:19:02.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.627 7f4069445700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4040002050 con 0 2020-07-06T13:19:02.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.635 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4054004c70 con 0x7f40640a31c0 2020-07-06T13:19:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4040001200 con 0 2020-07-06T13:19:02.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4060a64700 1 -- 172.21.15.118:0/3529175626 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (574334944 0 2374206864) 0x7f4054004300 con 0x7f40640a31c0 2020-07-06T13:19:02.727 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:02.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 >> 172.21.15.118:6800/9723 conn(0x7f4044006ed0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-07-06T13:19:02.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 >> 172.21.15.118:6790/0 conn(0x7f40640a31c0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-07-06T13:19:02.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 shutdown_connections 2020-07-06T13:19:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 shutdown_connections 2020-07-06T13:19:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 wait complete. 2020-07-06T13:19:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.727 7f4069445700 1 -- 172.21.15.118:0/3529175626 >> 172.21.15.118:0/3529175626 conn(0x7f40640993c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:02.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2020-07-06T13:19:02.738 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-07-06T13:19:02.818 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:02.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fccaa197700 1 Processor -- start 2020-07-06T13:19:02.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fccaa197700 1 -- - start start 2020-07-06T13:19:02.824 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fccaa197700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca414ba60 con 0 2020-07-06T13:19:02.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fccaa197700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca414be00 con 0 2020-07-06T13:19:02.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca3fff700 1 -- 172.21.15.118:0/3901574173 learned_addr learned my addr 172.21.15.118:0/3901574173 2020-07-06T13:19:02.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc8c003630 con 0x7fcca4148020 2020-07-06T13:19:02.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1573961463 0 0) 0x7fcc8c0039b0 con 0x7fcca4148020 2020-07-06T13:19:02.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fcc88002a20 con 0 2020-07-06T13:19:02.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc94002620 con 0x7fcca414b320 2020-07-06T13:19:02.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1517218670 0 0) 0x7fcc940029a0 con 0x7fcca414b320 2020-07-06T13:19:02.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fcc880046c0 con 0 2020-07-06T13:19:02.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1379516683 0 0) 0x7fcc8c003f80 con 0x7fcca4148020 2020-07-06T13:19:02.827 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 >> 172.21.15.118:6789/0 conn(0x7fcca414b320 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-07-06T13:19:02.827 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca407a7e0 con 0 2020-07-06T13:19:02.827 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fcca40e9f40 con 0x7fcca4148020 2020-07-06T13:19:02.827 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fcca2ffd700 1 -- 172.21.15.118:0/3901574173 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc8c001050 con 0x7fcca4148020 2020-07-06T13:19:02.827 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.823 7fccaa197700 1 -- 172.21.15.118:0/3901574173 >> 172.21.15.118:6791/0 conn(0x7fcca4148020 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-07-06T13:19:02.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- 172.21.15.118:0/3901574173 shutdown_connections 2020-07-06T13:19:02.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- 172.21.15.118:0/3901574173 shutdown_connections 2020-07-06T13:19:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- 172.21.15.118:0/3901574173 wait complete. 2020-07-06T13:19:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- 172.21.15.118:0/3901574173 >> 172.21.15.118:0/3901574173 conn(0x7fcca4143f50 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 Processor -- start 2020-07-06T13:19:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- - start start 2020-07-06T13:19:02.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.827 7fccaa197700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40a3c50 con 0 2020-07-06T13:19:02.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fccaa197700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca4095c80 con 0 2020-07-06T13:19:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca37fe700 1 -- 172.21.15.118:0/2541768064 learned_addr learned my addr 172.21.15.118:0/2541768064 2020-07-06T13:19:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc94002430 con 0x7fcca40a5010 2020-07-06T13:19:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (460630516 0 0) 0x7fcc940027b0 con 0x7fcca40a5010 2020-07-06T13:19:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fcc7c002960 con 0 2020-07-06T13:19:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc8c000e50 con 0x7fcca40a3260 2020-07-06T13:19:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (940763371 0 0) 0x7fcc8c001570 con 0x7fcca40a3260 2020-07-06T13:19:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fcc7c004620 con 0 2020-07-06T13:19:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3914827725 0 0) 0x7fcc940012f0 con 0x7fcca40a5010 2020-07-06T13:19:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcc7c002ee0 con 0 2020-07-06T13:19:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3194986598 0 0) 0x7fcc8c0018f0 con 0x7fcca40a3260 2020-07-06T13:19:02.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcc7c003540 con 0 2020-07-06T13:19:02.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (968618234 0 0) 0x7fcc940018c0 con 0x7fcca40a5010 2020-07-06T13:19:02.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 >> 172.21.15.118:6790/0 conn(0x7fcca40a3260 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-07-06T13:19:02.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca407aa40 con 0 2020-07-06T13:19:02.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fccaa197700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca4072b10 con 0 2020-07-06T13:19:02.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fccaa197700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca40a6a90 con 0 2020-07-06T13:19:02.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fcc94000f70 con 0x7fcca40a5010 2020-07-06T13:19:02.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fcc94001cf0 con 0x7fcca40a5010 2020-07-06T13:19:02.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fcc94004830 con 0x7fcca40a5010 2020-07-06T13:19:02.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.831 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fcc94004ca0 con 0x7fcca40a5010 2020-07-06T13:19:02.838 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.839 7fccaa197700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80002050 con 0 2020-07-06T13:19:02.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.843 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fcc94004f40 con 0x7fcca40a5010 2020-07-06T13:19:02.934 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc80001200 con 0 2020-07-06T13:19:02.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fcca17fa700 1 -- 172.21.15.118:0/2541768064 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (832126871 0 2374206864) 0x7fcc940043b0 con 0x7fcca40a5010 2020-07-06T13:19:02.941 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 >> 172.21.15.118:6800/9723 conn(0x7fcc7c006ed0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-07-06T13:19:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 >> 172.21.15.118:6791/0 conn(0x7fcca40a5010 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-07-06T13:19:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 shutdown_connections 2020-07-06T13:19:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 shutdown_connections 2020-07-06T13:19:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 wait complete. 2020-07-06T13:19:02.943 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:02.935 7fccaa197700 1 -- 172.21.15.118:0/2541768064 >> 172.21.15.118:0/2541768064 conn(0x7fcca4099470 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:02.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2020-07-06T13:19:02.951 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-07-06T13:19:03.035 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:03.041 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 Processor -- start 2020-07-06T13:19:03.042 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- - start start 2020-07-06T13:19:03.042 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74414ba50 con 0 2020-07-06T13:19:03.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74414bdf0 con 0 2020-07-06T13:19:03.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe749453700 1 -- 172.21.15.118:0/3060403554 learned_addr learned my addr 172.21.15.118:0/3060403554 2020-07-06T13:19:03.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe7400022a0 con 0x7fe744148010 2020-07-06T13:19:03.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3413603081 0 0) 0x7fe740002620 con 0x7fe744148010 2020-07-06T13:19:03.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe72c002a20 con 0 2020-07-06T13:19:03.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe734003630 con 0x7fe74414b310 2020-07-06T13:19:03.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3842519345 0 0) 0x7fe7340039b0 con 0x7fe74414b310 2020-07-06T13:19:03.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe72c0046c0 con 0 2020-07-06T13:19:03.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3863772584 0 0) 0x7fe740002bf0 con 0x7fe744148010 2020-07-06T13:19:03.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 >> 172.21.15.118:6790/0 conn(0x7fe74414b310 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-07-06T13:19:03.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74407a7d0 con 0 2020-07-06T13:19:03.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe7440e9f30 con 0x7fe744148010 2020-07-06T13:19:03.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe748c52700 1 -- 172.21.15.118:0/3060403554 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe740001050 con 0x7fe744148010 2020-07-06T13:19:03.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- 172.21.15.118:0/3060403554 >> 172.21.15.118:6791/0 conn(0x7fe744148010 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-07-06T13:19:03.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- 172.21.15.118:0/3060403554 shutdown_connections 2020-07-06T13:19:03.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- 172.21.15.118:0/3060403554 shutdown_connections 2020-07-06T13:19:03.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- 172.21.15.118:0/3060403554 wait complete. 2020-07-06T13:19:03.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.043 7fe74bc2e700 1 -- 172.21.15.118:0/3060403554 >> 172.21.15.118:0/3060403554 conn(0x7fe744143f40 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.049 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 Processor -- start 2020-07-06T13:19:03.049 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 -- - start start 2020-07-06T13:19:03.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440a3b80 con 0 2020-07-06T13:19:03.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440a6950 con 0 2020-07-06T13:19:03.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe749453700 1 -- 172.21.15.118:0/858415583 learned_addr learned my addr 172.21.15.118:0/858415583 2020-07-06T13:19:03.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe734003470 con 0x7fe7440a61a0 2020-07-06T13:19:03.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2346086833 0 0) 0x7fe734003d40 con 0x7fe7440a61a0 2020-07-06T13:19:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe724002960 con 0 2020-07-06T13:19:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe740000e50 con 0x7fe7440a3190 2020-07-06T13:19:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (342586653 0 0) 0x7fe740001ff0 con 0x7fe7440a3190 2020-07-06T13:19:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe724004620 con 0 2020-07-06T13:19:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1848700887 0 0) 0x7fe734000e50 con 0x7fe7440a61a0 2020-07-06T13:19:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe724002ee0 con 0 2020-07-06T13:19:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1303136436 0 0) 0x7fe740002370 con 0x7fe7440a3190 2020-07-06T13:19:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe724003540 con 0 2020-07-06T13:19:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1106190764 0 0) 0x7fe740001570 con 0x7fe7440a3190 2020-07-06T13:19:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 >> 172.21.15.118:6791/0 conn(0x7fe7440a61a0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-07-06T13:19:03.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74407aa30 con 0 2020-07-06T13:19:03.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744072bd0 con 0 2020-07-06T13:19:03.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74418b0e0 con 0 2020-07-06T13:19:03.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe740000bf0 con 0x7fe7440a3190 2020-07-06T13:19:03.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe7400019a0 con 0x7fe7440a3190 2020-07-06T13:19:03.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fe740001be0 con 0x7fe7440a3190 2020-07-06T13:19:03.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.047 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fe740004a10 con 0x7fe7440a3190 2020-07-06T13:19:03.055 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.055 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe720002050 con 0 2020-07-06T13:19:03.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.059 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe740003090 con 0x7fe7440a3190 2020-07-06T13:19:03.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.151 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe720001200 con 0 2020-07-06T13:19:03.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.151 7fe732ffd700 1 -- 172.21.15.118:0/858415583 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (92182286 0 2374206864) 0x7fe7400034f0 con 0x7fe7440a3190 2020-07-06T13:19:03.152 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:03.153 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.151 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 >> 172.21.15.118:6800/9723 conn(0x7fe724006e70 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-07-06T13:19:03.153 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.151 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 >> 172.21.15.118:6789/0 conn(0x7fe7440a3190 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-07-06T13:19:03.153 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.155 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 shutdown_connections 2020-07-06T13:19:03.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.155 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 shutdown_connections 2020-07-06T13:19:03.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.155 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 wait complete. 2020-07-06T13:19:03.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.155 7fe74bc2e700 1 -- 172.21.15.118:0/858415583 >> 172.21.15.118:0/858415583 conn(0x7fe744099320 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2020-07-06T13:19:03.170 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-07-06T13:19:03.252 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:03.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 Processor -- start 2020-07-06T13:19:03.262 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 -- - start start 2020-07-06T13:19:03.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30414ba50 con 0 2020-07-06T13:19:03.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30414bdf0 con 0 2020-07-06T13:19:03.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb309dbb700 1 -- 172.21.15.118:0/3990948450 learned_addr learned my addr 172.21.15.118:0/3990948450 2020-07-06T13:19:03.264 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb300002620 con 0x7fb304148010 2020-07-06T13:19:03.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4040076175 0 0) 0x7fb3000029a0 con 0x7fb304148010 2020-07-06T13:19:03.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2ec002a20 con 0 2020-07-06T13:19:03.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb2f4003630 con 0x7fb30414b310 2020-07-06T13:19:03.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2565870200 0 0) 0x7fb2f40039b0 con 0x7fb30414b310 2020-07-06T13:19:03.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2ec0046c0 con 0 2020-07-06T13:19:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2607703820 0 0) 0x7fb300002f70 con 0x7fb304148010 2020-07-06T13:19:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 >> 172.21.15.118:6789/0 conn(0x7fb30414b310 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-07-06T13:19:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30407a7d0 con 0 2020-07-06T13:19:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb3040e9f30 con 0x7fb304148010 2020-07-06T13:19:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb3095ba700 1 -- 172.21.15.118:0/3990948450 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3000013d0 con 0x7fb304148010 2020-07-06T13:19:03.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 -- 172.21.15.118:0/3990948450 >> 172.21.15.118:6790/0 conn(0x7fb304148010 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-07-06T13:19:03.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.263 7fb30c596700 1 -- 172.21.15.118:0/3990948450 shutdown_connections 2020-07-06T13:19:03.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- 172.21.15.118:0/3990948450 shutdown_connections 2020-07-06T13:19:03.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- 172.21.15.118:0/3990948450 wait complete. 2020-07-06T13:19:03.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- 172.21.15.118:0/3990948450 >> 172.21.15.118:0/3990948450 conn(0x7fb304143f40 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.270 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 Processor -- start 2020-07-06T13:19:03.270 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- - start start 2020-07-06T13:19:03.270 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3040a3b80 con 0 2020-07-06T13:19:03.270 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3040a6950 con 0 2020-07-06T13:19:03.270 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30a5bc700 1 -- 172.21.15.118:0/2917903276 learned_addr learned my addr 172.21.15.118:0/2917903276 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb300001390 con 0x7fb3040a3190 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (947572739 0 0) 0x7fb300002370 con 0x7fb3040a3190 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2e4002960 con 0 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb2f4003470 con 0x7fb3040a61a0 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (805495956 0 0) 0x7fb2f4003d40 con 0x7fb3040a61a0 2020-07-06T13:19:03.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2e4004620 con 0 2020-07-06T13:19:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1204954402 0 0) 0x7fb2f4003fb0 con 0x7fb3040a61a0 2020-07-06T13:19:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2e4002ee0 con 0 2020-07-06T13:19:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1565112291 0 0) 0x7fb3000027e0 con 0x7fb3040a3190 2020-07-06T13:19:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2e4003540 con 0 2020-07-06T13:19:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1719973402 0 0) 0x7fb2f40010f0 con 0x7fb3040a61a0 2020-07-06T13:19:03.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 >> 172.21.15.118:6791/0 conn(0x7fb3040a3190 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=67 cs=1 l=1).mark_down 2020-07-06T13:19:03.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30407aa30 con 0 2020-07-06T13:19:03.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.267 7fb30c596700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb304072bd0 con 0 2020-07-06T13:19:03.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.271 7fb30c596700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30418b0e0 con 0 2020-07-06T13:19:03.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.271 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb304116dc0 con 0x7fb3040a61a0 2020-07-06T13:19:03.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.271 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb2f4001520 con 0x7fb3040a61a0 2020-07-06T13:19:03.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.271 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fb2f4004260 con 0x7fb3040a61a0 2020-07-06T13:19:03.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.271 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fb2f4005c80 con 0x7fb3040a61a0 2020-07-06T13:19:03.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.275 7fb30c596700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0002050 con 0 2020-07-06T13:19:03.281 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.283 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb2f4001760 con 0x7fb3040a61a0 2020-07-06T13:19:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2e0001200 con 0 2020-07-06T13:19:03.375 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb2f37fe700 1 -- 172.21.15.118:0/2917903276 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (383520633 0 2374206864) 0x7fb2f4001a00 con 0x7fb3040a61a0 2020-07-06T13:19:03.375 INFO:teuthology.orchestra.run.smithi118.stdout:38654705670 2020-07-06T13:19:03.376 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 >> 172.21.15.118:6800/9723 conn(0x7fb2e4006f20 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-07-06T13:19:03.376 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 >> 172.21.15.118:6789/0 conn(0x7fb3040a61a0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-07-06T13:19:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 shutdown_connections 2020-07-06T13:19:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 shutdown_connections 2020-07-06T13:19:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 wait complete. 2020-07-06T13:19:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.375 7fb30c596700 1 -- 172.21.15.118:0/2917903276 >> 172.21.15.118:0/2917903276 conn(0x7fb304099320 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2020-07-06T13:19:03.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-07-06T13:19:03.391 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-06T13:19:03.472 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7f8cc700 1 Processor -- start 2020-07-06T13:19:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7f8cc700 1 -- - start start 2020-07-06T13:19:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7f8cc700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7814ba90 con 0 2020-07-06T13:19:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7f8cc700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7814be30 con 0 2020-07-06T13:19:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7d0f1700 1 -- 172.21.15.118:0/3115323908 learned_addr learned my addr 172.21.15.118:0/3115323908 2020-07-06T13:19:03.481 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc680022a0 con 0x7fdc78148050 2020-07-06T13:19:03.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (641633394 0 0) 0x7fdc68002620 con 0x7fdc78148050 2020-07-06T13:19:03.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdc64002a20 con 0 2020-07-06T13:19:03.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc6c003630 con 0x7fdc7814b350 2020-07-06T13:19:03.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3705692875 0 0) 0x7fdc6c003930 con 0x7fdc7814b350 2020-07-06T13:19:03.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdc640046c0 con 0 2020-07-06T13:19:03.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2047802017 0 0) 0x7fdc68002bf0 con 0x7fdc78148050 2020-07-06T13:19:03.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 >> 172.21.15.118:6790/0 conn(0x7fdc7814b350 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-07-06T13:19:03.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.479 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7807a7f0 con 0 2020-07-06T13:19:03.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdc780e9f70 con 0x7fdc78148050 2020-07-06T13:19:03.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7c8f0700 1 -- 172.21.15.118:0/3115323908 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc68001050 con 0x7fdc78148050 2020-07-06T13:19:03.484 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- 172.21.15.118:0/3115323908 >> 172.21.15.118:6791/0 conn(0x7fdc78148050 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-07-06T13:19:03.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- 172.21.15.118:0/3115323908 shutdown_connections 2020-07-06T13:19:03.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- 172.21.15.118:0/3115323908 shutdown_connections 2020-07-06T13:19:03.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- 172.21.15.118:0/3115323908 wait complete. 2020-07-06T13:19:03.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- 172.21.15.118:0/3115323908 >> 172.21.15.118:0/3115323908 conn(0x7fdc78143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 Processor -- start 2020-07-06T13:19:03.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- - start start 2020-07-06T13:19:03.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc780a3b00 con 0 2020-07-06T13:19:03.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7f8cc700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc780a6770 con 0 2020-07-06T13:19:03.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.483 7fdc7d8f2700 1 -- 172.21.15.118:0/480625671 learned_addr learned my addr 172.21.15.118:0/480625671 2020-07-06T13:19:03.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc6c003e70 con 0x7fdc780a6120 2020-07-06T13:19:03.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1855614847 0 0) 0x7fdc6c003470 con 0x7fdc780a6120 2020-07-06T13:19:03.489 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdc58002960 con 0 2020-07-06T13:19:03.489 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc68001010 con 0x7fdc780a3110 2020-07-06T13:19:03.489 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1830837430 0 0) 0x7fdc68001ff0 con 0x7fdc780a3110 2020-07-06T13:19:03.489 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdc58004620 con 0 2020-07-06T13:19:03.490 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4103485816 0 0) 0x7fdc68002380 con 0x7fdc780a3110 2020-07-06T13:19:03.490 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdc58002ee0 con 0 2020-07-06T13:19:03.490 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1686498922 0 0) 0x7fdc6c003990 con 0x7fdc780a6120 2020-07-06T13:19:03.490 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdc58003540 con 0 2020-07-06T13:19:03.490 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3616872267 0 0) 0x7fdc68001810 con 0x7fdc780a3110 2020-07-06T13:19:03.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 >> 172.21.15.118:6791/0 conn(0x7fdc780a6120 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-07-06T13:19:03.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7807aa50 con 0 2020-07-06T13:19:03.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc780b2510 con 0 2020-07-06T13:19:03.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7818af80 con 0 2020-07-06T13:19:03.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdc68000bf0 con 0x7fdc780a3110 2020-07-06T13:19:03.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fdc68001a80 con 0x7fdc780a3110 2020-07-06T13:19:03.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fdc68003390 con 0x7fdc780a3110 2020-07-06T13:19:03.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.487 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fdc68004fa0 con 0x7fdc780a3110 2020-07-06T13:19:03.493 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.491 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc54002050 con 0 2020-07-06T13:19:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.495 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fdc68003ba0 con 0x7fdc780a3110 2020-07-06T13:19:03.589 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.591 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 --> 172.21.15.118:6800/9723 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fdc54000f70 con 0 2020-07-06T13:19:03.590 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.591 7fdc76ffd700 1 -- 172.21.15.118:0/480625671 <== mgr.4110 172.21.15.118:6800/9723 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+59947 (2965378022 0 1785416480) 0x7fdc78116e00 con 0x7fdc58006f20 2020-07-06T13:19:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2020-07-06T13:19:03.593 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:03.594 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 >> 172.21.15.118:6800/9723 conn(0x7fdc58006f20 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-07-06T13:19:03.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 >> 172.21.15.118:6790/0 conn(0x7fdc780a3110 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-07-06T13:19:03.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 shutdown_connections 2020-07-06T13:19:03.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 shutdown_connections 2020-07-06T13:19:03.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 wait complete. 2020-07-06T13:19:03.597 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.595 7fdc7f8cc700 1 -- 172.21.15.118:0/480625671 >> 172.21.15.118:0/480625671 conn(0x7fdc78099240 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.608 INFO:teuthology.orchestra.run.smithi118.stdout:{"version":24,"stamp":"2020-07-06 13:19:03.472665","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"kb":377487360,"kb_used":4196736,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290624,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"2.017741"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765438","last_change":"2020-07-06 13:18:57.764394","last_active":"2020-07-06 13:18:58.765438","last_peered":"2020-07-06 13:18:58.765438","last_clean":"2020-07-06 13:18:58.765438","last_became_active":"2020-07-06 13:18:57.763933","last_became_peered":"2020-07-06 13:18:57.763933","last_unstale":"2020-07-06 13:18:58.765438","last_undegraded":"2020-07-06 13:18:58.765438","last_fullsized":"2020-07-06 13:18:58.765438","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765653","last_change":"2020-07-06 13:18:55.500687","last_active":"2020-07-06 13:18:58.765653","last_peered":"2020-07-06 13:18:58.765653","last_clean":"2020-07-06 13:18:58.765653","last_became_active":"2020-07-06 13:18:55.500258","last_became_peered":"2020-07-06 13:18:55.500258","last_unstale":"2020-07-06 13:18:58.765653","last_undegraded":"2020-07-06 13:18:58.765653","last_fullsized":"2020-07-06 13:18:58.765653","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'3","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.780385","last_change":"2020-07-06 13:18:57.523588","last_active":"2020-07-06 13:18:59.780385","last_peered":"2020-07-06 13:18:59.780385","last_clean":"2020-07-06 13:18:59.780385","last_became_active":"2020-07-06 13:18:57.523149","last_became_peered":"2020-07-06 13:18:57.523149","last_unstale":"2020-07-06 13:18:59.780385","last_undegraded":"2020-07-06 13:18:59.780385","last_fullsized":"2020-07-06 13:18:59.780385","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.773265","last_change":"2020-07-06 13:18:58.767646","last_active":"2020-07-06 13:18:58.773265","last_peered":"2020-07-06 13:18:58.773265","last_clean":"2020-07-06 13:18:58.773265","last_became_active":"2020-07-06 13:18:58.766993","last_became_peered":"2020-07-06 13:18:58.766993","last_unstale":"2020-07-06 13:18:58.773265","last_undegraded":"2020-07-06 13:18:58.773265","last_fullsized":"2020-07-06 13:18:58.773265","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765264","last_change":"2020-07-06 13:18:55.502111","last_active":"2020-07-06 13:18:58.765264","last_peered":"2020-07-06 13:18:58.765264","last_clean":"2020-07-06 13:18:58.765264","last_became_active":"2020-07-06 13:18:55.501638","last_became_peered":"2020-07-06 13:18:55.501638","last_unstale":"2020-07-06 13:18:58.765264","last_undegraded":"2020-07-06 13:18:58.765264","last_fullsized":"2020-07-06 13:18:58.765264","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"16'7","reported_seq":"18","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794556","last_change":"2020-07-06 13:18:57.524181","last_active":"2020-07-06 13:18:59.794556","last_peered":"2020-07-06 13:18:59.794556","last_clean":"2020-07-06 13:18:59.794556","last_became_active":"2020-07-06 13:18:57.523812","last_became_peered":"2020-07-06 13:18:57.523812","last_unstale":"2020-07-06 13:18:59.794556","last_undegraded":"2020-07-06 13:18:59.794556","last_fullsized":"2020-07-06 13:18:59.794556","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.770428","last_change":"2020-07-06 13:18:58.767184","last_active":"2020-07-06 13:18:58.770428","last_peered":"2020-07-06 13:18:58.770428","last_clean":"2020-07-06 13:18:58.770428","last_became_active":"2020-07-06 13:18:58.766663","last_became_peered":"2020-07-06 13:18:58.766663","last_unstale":"2020-07-06 13:18:58.770428","last_undegraded":"2020-07-06 13:18:58.770428","last_fullsized":"2020-07-06 13:18:58.770428","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761237","last_change":"2020-07-06 13:18:55.500175","last_active":"2020-07-06 13:18:58.761237","last_peered":"2020-07-06 13:18:58.761237","last_clean":"2020-07-06 13:18:58.761237","last_became_active":"2020-07-06 13:18:55.499759","last_became_peered":"2020-07-06 13:18:55.499759","last_unstale":"2020-07-06 13:18:58.761237","last_undegraded":"2020-07-06 13:18:58.761237","last_fullsized":"2020-07-06 13:18:58.761237","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794116","last_change":"2020-07-06 13:18:57.517469","last_active":"2020-07-06 13:18:59.794116","last_peered":"2020-07-06 13:18:59.794116","last_clean":"2020-07-06 13:18:59.794116","last_became_active":"2020-07-06 13:18:57.517101","last_became_peered":"2020-07-06 13:18:57.517101","last_unstale":"2020-07-06 13:18:59.794116","last_undegraded":"2020-07-06 13:18:59.794116","last_fullsized":"2020-07-06 13:18:59.794116","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761248","last_change":"2020-07-06 13:18:57.763440","last_active":"2020-07-06 13:18:58.761248","last_peered":"2020-07-06 13:18:58.761248","last_clean":"2020-07-06 13:18:58.761248","last_became_active":"2020-07-06 13:18:57.763023","last_became_peered":"2020-07-06 13:18:57.763023","last_unstale":"2020-07-06 13:18:58.761248","last_undegraded":"2020-07-06 13:18:58.761248","last_fullsized":"2020-07-06 13:18:58.761248","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.762140","last_change":"2020-07-06 13:18:55.502767","last_active":"2020-07-06 13:18:58.762140","last_peered":"2020-07-06 13:18:58.762140","last_clean":"2020-07-06 13:18:58.762140","last_became_active":"2020-07-06 13:18:55.502153","last_became_peered":"2020-07-06 13:18:55.502153","last_unstale":"2020-07-06 13:18:58.762140","last_undegraded":"2020-07-06 13:18:58.762140","last_fullsized":"2020-07-06 13:18:58.762140","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765558","last_change":"2020-07-06 13:18:57.523190","last_active":"2020-07-06 13:18:58.765558","last_peered":"2020-07-06 13:18:58.765558","last_clean":"2020-07-06 13:18:58.765558","last_became_active":"2020-07-06 13:18:57.522805","last_became_peered":"2020-07-06 13:18:57.522805","last_unstale":"2020-07-06 13:18:58.765558","last_undegraded":"2020-07-06 13:18:58.765558","last_fullsized":"2020-07-06 13:18:58.765558","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765269","last_change":"2020-07-06 13:18:57.762877","last_active":"2020-07-06 13:18:58.765269","last_peered":"2020-07-06 13:18:58.765269","last_clean":"2020-07-06 13:18:58.765269","last_became_active":"2020-07-06 13:18:57.762534","last_became_peered":"2020-07-06 13:18:57.762534","last_unstale":"2020-07-06 13:18:58.765269","last_undegraded":"2020-07-06 13:18:58.765269","last_fullsized":"2020-07-06 13:18:58.765269","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761149","last_change":"2020-07-06 13:18:55.500992","last_active":"2020-07-06 13:18:58.761149","last_peered":"2020-07-06 13:18:58.761149","last_clean":"2020-07-06 13:18:58.761149","last_became_active":"2020-07-06 13:18:55.500557","last_became_peered":"2020-07-06 13:18:55.500557","last_unstale":"2020-07-06 13:18:58.761149","last_undegraded":"2020-07-06 13:18:58.761149","last_fullsized":"2020-07-06 13:18:58.761149","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'5","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794594","last_change":"2020-07-06 13:18:57.522944","last_active":"2020-07-06 13:18:59.794594","last_peered":"2020-07-06 13:18:59.794594","last_clean":"2020-07-06 13:18:59.794594","last_became_active":"2020-07-06 13:18:57.522565","last_became_peered":"2020-07-06 13:18:57.522565","last_unstale":"2020-07-06 13:18:59.794594","last_undegraded":"2020-07-06 13:18:59.794594","last_fullsized":"2020-07-06 13:18:59.794594","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.776120","last_change":"2020-07-06 13:18:58.771135","last_active":"2020-07-06 13:18:58.776120","last_peered":"2020-07-06 13:18:58.776120","last_clean":"2020-07-06 13:18:58.776120","last_became_active":"2020-07-06 13:18:58.770758","last_became_peered":"2020-07-06 13:18:58.770758","last_unstale":"2020-07-06 13:18:58.776120","last_undegraded":"2020-07-06 13:18:58.776120","last_fullsized":"2020-07-06 13:18:58.776120","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765454","last_change":"2020-07-06 13:18:55.504245","last_active":"2020-07-06 13:18:58.765454","last_peered":"2020-07-06 13:18:58.765454","last_clean":"2020-07-06 13:18:58.765454","last_became_active":"2020-07-06 13:18:55.502194","last_became_peered":"2020-07-06 13:18:55.502194","last_unstale":"2020-07-06 13:18:58.765454","last_undegraded":"2020-07-06 13:18:58.765454","last_fullsized":"2020-07-06 13:18:58.765454","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.778996","last_change":"2020-07-06 13:18:57.515326","last_active":"2020-07-06 13:18:59.778996","last_peered":"2020-07-06 13:18:59.778996","last_clean":"2020-07-06 13:18:59.778996","last_became_active":"2020-07-06 13:18:57.514862","last_became_peered":"2020-07-06 13:18:57.514862","last_unstale":"2020-07-06 13:18:59.778996","last_undegraded":"2020-07-06 13:18:59.778996","last_fullsized":"2020-07-06 13:18:59.778996","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761493","last_change":"2020-07-06 13:18:57.765514","last_active":"2020-07-06 13:18:58.761493","last_peered":"2020-07-06 13:18:58.761493","last_clean":"2020-07-06 13:18:58.761493","last_became_active":"2020-07-06 13:18:57.765124","last_became_peered":"2020-07-06 13:18:57.765124","last_unstale":"2020-07-06 13:18:58.761493","last_undegraded":"2020-07-06 13:18:58.761493","last_fullsized":"2020-07-06 13:18:58.761493","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765332","last_change":"2020-07-06 13:18:55.501814","last_active":"2020-07-06 13:18:58.765332","last_peered":"2020-07-06 13:18:58.765332","last_clean":"2020-07-06 13:18:58.765332","last_became_active":"2020-07-06 13:18:55.501352","last_became_peered":"2020-07-06 13:18:55.501352","last_unstale":"2020-07-06 13:18:58.765332","last_undegraded":"2020-07-06 13:18:58.765332","last_fullsized":"2020-07-06 13:18:58.765332","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'6","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794508","last_change":"2020-07-06 13:18:57.524235","last_active":"2020-07-06 13:18:59.794508","last_peered":"2020-07-06 13:18:59.794508","last_clean":"2020-07-06 13:18:59.794508","last_became_active":"2020-07-06 13:18:57.523854","last_became_peered":"2020-07-06 13:18:57.523854","last_unstale":"2020-07-06 13:18:59.794508","last_undegraded":"2020-07-06 13:18:59.794508","last_fullsized":"2020-07-06 13:18:59.794508","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765551","last_change":"2020-07-06 13:18:57.762759","last_active":"2020-07-06 13:18:58.765551","last_peered":"2020-07-06 13:18:58.765551","last_clean":"2020-07-06 13:18:58.765551","last_became_active":"2020-07-06 13:18:57.762370","last_became_peered":"2020-07-06 13:18:57.762370","last_unstale":"2020-07-06 13:18:58.765551","last_undegraded":"2020-07-06 13:18:58.765551","last_fullsized":"2020-07-06 13:18:58.765551","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761411","last_change":"2020-07-06 13:18:55.500752","last_active":"2020-07-06 13:18:58.761411","last_peered":"2020-07-06 13:18:58.761411","last_clean":"2020-07-06 13:18:58.761411","last_became_active":"2020-07-06 13:18:55.500332","last_became_peered":"2020-07-06 13:18:55.500332","last_unstale":"2020-07-06 13:18:58.761411","last_undegraded":"2020-07-06 13:18:58.761411","last_fullsized":"2020-07-06 13:18:58.761411","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.782131","last_change":"2020-07-06 13:18:57.523679","last_active":"2020-07-06 13:18:59.782131","last_peered":"2020-07-06 13:18:59.782131","last_clean":"2020-07-06 13:18:59.782131","last_became_active":"2020-07-06 13:18:57.523266","last_became_peered":"2020-07-06 13:18:57.523266","last_unstale":"2020-07-06 13:18:59.782131","last_undegraded":"2020-07-06 13:18:59.782131","last_fullsized":"2020-07-06 13:18:59.782131","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":14,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.482}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.674}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.817}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":10,"kb":94371840,"kb_used":1049136,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322704,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.911}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.238}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.676}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":2.267}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.785}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":11,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.144}]}]}]} 2020-07-06T13:19:03.610 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-06T13:19:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:03.701 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 Processor -- start 2020-07-06T13:19:03.701 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- - start start 2020-07-06T13:19:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725414ba80 con 0 2020-07-06T13:19:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725414be20 con 0 2020-07-06T13:19:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7252025700 1 -- 172.21.15.118:0/2199868220 learned_addr learned my addr 172.21.15.118:0/2199868220 2020-07-06T13:19:03.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7248003630 con 0x7f725414b340 2020-07-06T13:19:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f72440022a0 con 0x7f7254148040 2020-07-06T13:19:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2251628011 0 0) 0x7f72480039b0 con 0x7f725414b340 2020-07-06T13:19:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7238002ea0 con 0 2020-07-06T13:19:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1536694162 0 0) 0x7f72440025a0 con 0x7f7254148040 2020-07-06T13:19:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f72380046b0 con 0 2020-07-06T13:19:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (29853961 0 0) 0x7f7248003ea0 con 0x7f725414b340 2020-07-06T13:19:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 >> 172.21.15.118:6789/0 conn(0x7f7254148040 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-07-06T13:19:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725407a7e0 con 0 2020-07-06T13:19:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7254116df0 con 0x7f725414b340 2020-07-06T13:19:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f7251824700 1 -- 172.21.15.118:0/2199868220 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7248001010 con 0x7f725414b340 2020-07-06T13:19:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- 172.21.15.118:0/2199868220 >> 172.21.15.118:6790/0 conn(0x7f725414b340 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-07-06T13:19:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- 172.21.15.118:0/2199868220 shutdown_connections 2020-07-06T13:19:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- 172.21.15.118:0/2199868220 shutdown_connections 2020-07-06T13:19:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- 172.21.15.118:0/2199868220 wait complete. 2020-07-06T13:19:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.703 7f72589a4700 1 -- 172.21.15.118:0/2199868220 >> 172.21.15.118:0/2199868220 conn(0x7f7254143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f72589a4700 1 Processor -- start 2020-07-06T13:19:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f72589a4700 1 -- - start start 2020-07-06T13:19:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f72589a4700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72540a3b60 con 0 2020-07-06T13:19:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f72589a4700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72540a6930 con 0 2020-07-06T13:19:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7252826700 1 -- 172.21.15.118:0/4064968095 learned_addr learned my addr 172.21.15.118:0/4064968095 2020-07-06T13:19:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7244002080 con 0x7f72540a31a0 2020-07-06T13:19:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1851302485 0 0) 0x7f7244002400 con 0x7f72540a31a0 2020-07-06T13:19:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7230002960 con 0 2020-07-06T13:19:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7248000e50 con 0x7f72540a6180 2020-07-06T13:19:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3350426679 0 0) 0x7f72480033e0 con 0x7f72540a6180 2020-07-06T13:19:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7230004620 con 0 2020-07-06T13:19:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.707 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (92376487 0 0) 0x7f7244000e50 con 0x7f72540a31a0 2020-07-06T13:19:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7230002ee0 con 0 2020-07-06T13:19:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (613420967 0 0) 0x7f7248003760 con 0x7f72540a6180 2020-07-06T13:19:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7230003540 con 0 2020-07-06T13:19:03.713 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2352488510 0 0) 0x7f7244001510 con 0x7f72540a31a0 2020-07-06T13:19:03.713 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 >> 172.21.15.118:6789/0 conn(0x7f72540a6180 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-07-06T13:19:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725407aa40 con 0 2020-07-06T13:19:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7244000bf0 con 0x7f72540a31a0 2020-07-06T13:19:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7244001940 con 0x7f72540a31a0 2020-07-06T13:19:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f72589a4700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72540b2640 con 0 2020-07-06T13:19:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f72589a4700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f725418b0e0 con 0 2020-07-06T13:19:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f72440046c0 con 0x7f72540a31a0 2020-07-06T13:19:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.711 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f7244005ff0 con 0x7f72540a31a0 2020-07-06T13:19:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.715 7f72589a4700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725407adc0 con 0 2020-07-06T13:19:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.719 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f725407adc0 con 0x7f72540a31a0 2020-07-06T13:19:03.811 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.811 7f72589a4700 1 -- 172.21.15.118:0/4064968095 --> 172.21.15.118:6800/9723 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f72541487d0 con 0 2020-07-06T13:19:03.812 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.811 7f7243fff700 1 -- 172.21.15.118:0/4064968095 <== mgr.4110 172.21.15.118:6800/9723 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+59947 (2965378022 0 1785416480) 0x7f7248000bf0 con 0x7f7230006ed0 2020-07-06T13:19:03.820 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2020-07-06T13:19:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 >> 172.21.15.118:6800/9723 conn(0x7f7230006ed0 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-07-06T13:19:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 >> 172.21.15.118:6790/0 conn(0x7f72540a31a0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-07-06T13:19:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 shutdown_connections 2020-07-06T13:19:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 shutdown_connections 2020-07-06T13:19:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 wait complete. 2020-07-06T13:19:03.837 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.815 7f72589a4700 1 -- 172.21.15.118:0/4064968095 >> 172.21.15.118:0/4064968095 conn(0x7f72540992e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.838 INFO:teuthology.orchestra.run.smithi118.stdout:{"version":24,"stamp":"2020-07-06 13:19:03.472665","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"kb":377487360,"kb_used":4196736,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290624,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"2.017741"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765438","last_change":"2020-07-06 13:18:57.764394","last_active":"2020-07-06 13:18:58.765438","last_peered":"2020-07-06 13:18:58.765438","last_clean":"2020-07-06 13:18:58.765438","last_became_active":"2020-07-06 13:18:57.763933","last_became_peered":"2020-07-06 13:18:57.763933","last_unstale":"2020-07-06 13:18:58.765438","last_undegraded":"2020-07-06 13:18:58.765438","last_fullsized":"2020-07-06 13:18:58.765438","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765653","last_change":"2020-07-06 13:18:55.500687","last_active":"2020-07-06 13:18:58.765653","last_peered":"2020-07-06 13:18:58.765653","last_clean":"2020-07-06 13:18:58.765653","last_became_active":"2020-07-06 13:18:55.500258","last_became_peered":"2020-07-06 13:18:55.500258","last_unstale":"2020-07-06 13:18:58.765653","last_undegraded":"2020-07-06 13:18:58.765653","last_fullsized":"2020-07-06 13:18:58.765653","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'3","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.780385","last_change":"2020-07-06 13:18:57.523588","last_active":"2020-07-06 13:18:59.780385","last_peered":"2020-07-06 13:18:59.780385","last_clean":"2020-07-06 13:18:59.780385","last_became_active":"2020-07-06 13:18:57.523149","last_became_peered":"2020-07-06 13:18:57.523149","last_unstale":"2020-07-06 13:18:59.780385","last_undegraded":"2020-07-06 13:18:59.780385","last_fullsized":"2020-07-06 13:18:59.780385","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.773265","last_change":"2020-07-06 13:18:58.767646","last_active":"2020-07-06 13:18:58.773265","last_peered":"2020-07-06 13:18:58.773265","last_clean":"2020-07-06 13:18:58.773265","last_became_active":"2020-07-06 13:18:58.766993","last_became_peered":"2020-07-06 13:18:58.766993","last_unstale":"2020-07-06 13:18:58.773265","last_undegraded":"2020-07-06 13:18:58.773265","last_fullsized":"2020-07-06 13:18:58.773265","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765264","last_change":"2020-07-06 13:18:55.502111","last_active":"2020-07-06 13:18:58.765264","last_peered":"2020-07-06 13:18:58.765264","last_clean":"2020-07-06 13:18:58.765264","last_became_active":"2020-07-06 13:18:55.501638","last_became_peered":"2020-07-06 13:18:55.501638","last_unstale":"2020-07-06 13:18:58.765264","last_undegraded":"2020-07-06 13:18:58.765264","last_fullsized":"2020-07-06 13:18:58.765264","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"16'7","reported_seq":"18","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794556","last_change":"2020-07-06 13:18:57.524181","last_active":"2020-07-06 13:18:59.794556","last_peered":"2020-07-06 13:18:59.794556","last_clean":"2020-07-06 13:18:59.794556","last_became_active":"2020-07-06 13:18:57.523812","last_became_peered":"2020-07-06 13:18:57.523812","last_unstale":"2020-07-06 13:18:59.794556","last_undegraded":"2020-07-06 13:18:59.794556","last_fullsized":"2020-07-06 13:18:59.794556","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.770428","last_change":"2020-07-06 13:18:58.767184","last_active":"2020-07-06 13:18:58.770428","last_peered":"2020-07-06 13:18:58.770428","last_clean":"2020-07-06 13:18:58.770428","last_became_active":"2020-07-06 13:18:58.766663","last_became_peered":"2020-07-06 13:18:58.766663","last_unstale":"2020-07-06 13:18:58.770428","last_undegraded":"2020-07-06 13:18:58.770428","last_fullsized":"2020-07-06 13:18:58.770428","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761237","last_change":"2020-07-06 13:18:55.500175","last_active":"2020-07-06 13:18:58.761237","last_peered":"2020-07-06 13:18:58.761237","last_clean":"2020-07-06 13:18:58.761237","last_became_active":"2020-07-06 13:18:55.499759","last_became_peered":"2020-07-06 13:18:55.499759","last_unstale":"2020-07-06 13:18:58.761237","last_undegraded":"2020-07-06 13:18:58.761237","last_fullsized":"2020-07-06 13:18:58.761237","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794116","last_change":"2020-07-06 13:18:57.517469","last_active":"2020-07-06 13:18:59.794116","last_peered":"2020-07-06 13:18:59.794116","last_clean":"2020-07-06 13:18:59.794116","last_became_active":"2020-07-06 13:18:57.517101","last_became_peered":"2020-07-06 13:18:57.517101","last_unstale":"2020-07-06 13:18:59.794116","last_undegraded":"2020-07-06 13:18:59.794116","last_fullsized":"2020-07-06 13:18:59.794116","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761248","last_change":"2020-07-06 13:18:57.763440","last_active":"2020-07-06 13:18:58.761248","last_peered":"2020-07-06 13:18:58.761248","last_clean":"2020-07-06 13:18:58.761248","last_became_active":"2020-07-06 13:18:57.763023","last_became_peered":"2020-07-06 13:18:57.763023","last_unstale":"2020-07-06 13:18:58.761248","last_undegraded":"2020-07-06 13:18:58.761248","last_fullsized":"2020-07-06 13:18:58.761248","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.762140","last_change":"2020-07-06 13:18:55.502767","last_active":"2020-07-06 13:18:58.762140","last_peered":"2020-07-06 13:18:58.762140","last_clean":"2020-07-06 13:18:58.762140","last_became_active":"2020-07-06 13:18:55.502153","last_became_peered":"2020-07-06 13:18:55.502153","last_unstale":"2020-07-06 13:18:58.762140","last_undegraded":"2020-07-06 13:18:58.762140","last_fullsized":"2020-07-06 13:18:58.762140","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765558","last_change":"2020-07-06 13:18:57.523190","last_active":"2020-07-06 13:18:58.765558","last_peered":"2020-07-06 13:18:58.765558","last_clean":"2020-07-06 13:18:58.765558","last_became_active":"2020-07-06 13:18:57.522805","last_became_peered":"2020-07-06 13:18:57.522805","last_unstale":"2020-07-06 13:18:58.765558","last_undegraded":"2020-07-06 13:18:58.765558","last_fullsized":"2020-07-06 13:18:58.765558","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765269","last_change":"2020-07-06 13:18:57.762877","last_active":"2020-07-06 13:18:58.765269","last_peered":"2020-07-06 13:18:58.765269","last_clean":"2020-07-06 13:18:58.765269","last_became_active":"2020-07-06 13:18:57.762534","last_became_peered":"2020-07-06 13:18:57.762534","last_unstale":"2020-07-06 13:18:58.765269","last_undegraded":"2020-07-06 13:18:58.765269","last_fullsized":"2020-07-06 13:18:58.765269","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761149","last_change":"2020-07-06 13:18:55.500992","last_active":"2020-07-06 13:18:58.761149","last_peered":"2020-07-06 13:18:58.761149","last_clean":"2020-07-06 13:18:58.761149","last_became_active":"2020-07-06 13:18:55.500557","last_became_peered":"2020-07-06 13:18:55.500557","last_unstale":"2020-07-06 13:18:58.761149","last_undegraded":"2020-07-06 13:18:58.761149","last_fullsized":"2020-07-06 13:18:58.761149","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'5","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794594","last_change":"2020-07-06 13:18:57.522944","last_active":"2020-07-06 13:18:59.794594","last_peered":"2020-07-06 13:18:59.794594","last_clean":"2020-07-06 13:18:59.794594","last_became_active":"2020-07-06 13:18:57.522565","last_became_peered":"2020-07-06 13:18:57.522565","last_unstale":"2020-07-06 13:18:59.794594","last_undegraded":"2020-07-06 13:18:59.794594","last_fullsized":"2020-07-06 13:18:59.794594","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.776120","last_change":"2020-07-06 13:18:58.771135","last_active":"2020-07-06 13:18:58.776120","last_peered":"2020-07-06 13:18:58.776120","last_clean":"2020-07-06 13:18:58.776120","last_became_active":"2020-07-06 13:18:58.770758","last_became_peered":"2020-07-06 13:18:58.770758","last_unstale":"2020-07-06 13:18:58.776120","last_undegraded":"2020-07-06 13:18:58.776120","last_fullsized":"2020-07-06 13:18:58.776120","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765454","last_change":"2020-07-06 13:18:55.504245","last_active":"2020-07-06 13:18:58.765454","last_peered":"2020-07-06 13:18:58.765454","last_clean":"2020-07-06 13:18:58.765454","last_became_active":"2020-07-06 13:18:55.502194","last_became_peered":"2020-07-06 13:18:55.502194","last_unstale":"2020-07-06 13:18:58.765454","last_undegraded":"2020-07-06 13:18:58.765454","last_fullsized":"2020-07-06 13:18:58.765454","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.778996","last_change":"2020-07-06 13:18:57.515326","last_active":"2020-07-06 13:18:59.778996","last_peered":"2020-07-06 13:18:59.778996","last_clean":"2020-07-06 13:18:59.778996","last_became_active":"2020-07-06 13:18:57.514862","last_became_peered":"2020-07-06 13:18:57.514862","last_unstale":"2020-07-06 13:18:59.778996","last_undegraded":"2020-07-06 13:18:59.778996","last_fullsized":"2020-07-06 13:18:59.778996","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761493","last_change":"2020-07-06 13:18:57.765514","last_active":"2020-07-06 13:18:58.761493","last_peered":"2020-07-06 13:18:58.761493","last_clean":"2020-07-06 13:18:58.761493","last_became_active":"2020-07-06 13:18:57.765124","last_became_peered":"2020-07-06 13:18:57.765124","last_unstale":"2020-07-06 13:18:58.761493","last_undegraded":"2020-07-06 13:18:58.761493","last_fullsized":"2020-07-06 13:18:58.761493","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765332","last_change":"2020-07-06 13:18:55.501814","last_active":"2020-07-06 13:18:58.765332","last_peered":"2020-07-06 13:18:58.765332","last_clean":"2020-07-06 13:18:58.765332","last_became_active":"2020-07-06 13:18:55.501352","last_became_peered":"2020-07-06 13:18:55.501352","last_unstale":"2020-07-06 13:18:58.765332","last_undegraded":"2020-07-06 13:18:58.765332","last_fullsized":"2020-07-06 13:18:58.765332","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'6","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.794508","last_change":"2020-07-06 13:18:57.524235","last_active":"2020-07-06 13:18:59.794508","last_peered":"2020-07-06 13:18:59.794508","last_clean":"2020-07-06 13:18:59.794508","last_became_active":"2020-07-06 13:18:57.523854","last_became_peered":"2020-07-06 13:18:57.523854","last_unstale":"2020-07-06 13:18:59.794508","last_undegraded":"2020-07-06 13:18:59.794508","last_fullsized":"2020-07-06 13:18:59.794508","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.765551","last_change":"2020-07-06 13:18:57.762759","last_active":"2020-07-06 13:18:58.765551","last_peered":"2020-07-06 13:18:58.765551","last_clean":"2020-07-06 13:18:58.765551","last_became_active":"2020-07-06 13:18:57.762370","last_became_peered":"2020-07-06 13:18:57.762370","last_unstale":"2020-07-06 13:18:58.765551","last_undegraded":"2020-07-06 13:18:58.765551","last_fullsized":"2020-07-06 13:18:58.765551","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:57.501330","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:57.501330","last_clean_scrub_stamp":"2020-07-06 13:18:57.501330","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-07-06 13:18:58.761411","last_change":"2020-07-06 13:18:55.500752","last_active":"2020-07-06 13:18:58.761411","last_peered":"2020-07-06 13:18:58.761411","last_clean":"2020-07-06 13:18:58.761411","last_became_active":"2020-07-06 13:18:55.500332","last_became_peered":"2020-07-06 13:18:55.500332","last_unstale":"2020-07-06 13:18:58.761411","last_undegraded":"2020-07-06 13:18:58.761411","last_fullsized":"2020-07-06 13:18:58.761411","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:54.485984","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:54.485984","last_clean_scrub_stamp":"2020-07-06 13:18:54.485984","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-07-06 13:18:59.782131","last_change":"2020-07-06 13:18:57.523679","last_active":"2020-07-06 13:18:59.782131","last_peered":"2020-07-06 13:18:59.782131","last_clean":"2020-07-06 13:18:59.782131","last_became_active":"2020-07-06 13:18:57.523266","last_became_peered":"2020-07-06 13:18:57.523266","last_unstale":"2020-07-06 13:18:59.782131","last_undegraded":"2020-07-06 13:18:59.782131","last_fullsized":"2020-07-06 13:18:59.782131","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-06 13:18:56.499403","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-06 13:18:56.499403","last_clean_scrub_stamp":"2020-07-06 13:18:56.499403","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":14,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.482}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.674}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.817}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":10,"kb":94371840,"kb_used":1049136,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322704,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.911}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.238}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.676}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":2.267}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.785}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":11,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.144}]}]}]} 2020-07-06T13:19:03.840 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-07-06T13:19:03.841 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-07-06T13:19:03.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-07-06T13:19:03.842 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-07-06T13:19:03.927 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:03.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.931 7f480d56b700 1 Processor -- start 2020-07-06T13:19:03.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.931 7f480d56b700 1 -- - start start 2020-07-06T13:19:03.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.931 7f480d56b700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480814ba80 con 0 2020-07-06T13:19:03.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.931 7f480d56b700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480814be20 con 0 2020-07-06T13:19:03.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.931 7f4807572700 1 -- 172.21.15.118:0/2890587594 learned_addr learned my addr 172.21.15.118:0/2890587594 2020-07-06T13:19:03.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f00022a0 con 0x7f480814b340 2020-07-06T13:19:03.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1799582315 0 0) 0x7f47f0002620 con 0x7f480814b340 2020-07-06T13:19:03.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f47e8002a20 con 0 2020-07-06T13:19:03.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f8003630 con 0x7f4808148040 2020-07-06T13:19:03.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3233913940 0 0) 0x7f47f80039b0 con 0x7f4808148040 2020-07-06T13:19:03.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f47e80046c0 con 0 2020-07-06T13:19:03.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2778274222 0 0) 0x7f47f8003e60 con 0x7f4808148040 2020-07-06T13:19:03.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 >> 172.21.15.118:6791/0 conn(0x7f480814b340 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-07-06T13:19:03.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480807a7e0 con 0 2020-07-06T13:19:03.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f48080e9f60 con 0x7f4808148040 2020-07-06T13:19:03.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- 172.21.15.118:0/2890587594 >> 172.21.15.118:6790/0 conn(0x7f4808148040 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-07-06T13:19:03.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f4806d71700 1 -- 172.21.15.118:0/2890587594 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f8001010 con 0x7f4808148040 2020-07-06T13:19:03.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- 172.21.15.118:0/2890587594 shutdown_connections 2020-07-06T13:19:03.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- 172.21.15.118:0/2890587594 shutdown_connections 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- 172.21.15.118:0/2890587594 wait complete. 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- 172.21.15.118:0/2890587594 >> 172.21.15.118:0/2890587594 conn(0x7f4808143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 Processor -- start 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- - start start 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080a3bd0 con 0 2020-07-06T13:19:03.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f480d56b700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080a69a0 con 0 2020-07-06T13:19:03.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.935 7f47fed71700 1 -- 172.21.15.118:0/4264209647 learned_addr learned my addr 172.21.15.118:0/4264209647 2020-07-06T13:19:03.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f00022a0 con 0x7f48080a61f0 2020-07-06T13:19:03.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4060004984 0 0) 0x7f47f0002520 con 0x7f48080a61f0 2020-07-06T13:19:03.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f47ec002960 con 0 2020-07-06T13:19:03.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f80038d0 con 0x7f48080a31e0 2020-07-06T13:19:03.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1029883349 0 0) 0x7f47f8000e50 con 0x7f48080a31e0 2020-07-06T13:19:03.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f47ec004620 con 0 2020-07-06T13:19:03.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1743922308 0 0) 0x7f47f8003410 con 0x7f48080a31e0 2020-07-06T13:19:03.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47ec002ee0 con 0 2020-07-06T13:19:03.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1400493320 0 0) 0x7f47f0000e50 con 0x7f48080a61f0 2020-07-06T13:19:03.958 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47ec003540 con 0 2020-07-06T13:19:03.958 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3150614670 0 0) 0x7f47f80017d0 con 0x7f48080a31e0 2020-07-06T13:19:03.959 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 >> 172.21.15.118:6791/0 conn(0x7f48080a61f0 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-07-06T13:19:03.959 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480807aa40 con 0 2020-07-06T13:19:03.959 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480d56b700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48080711b0 con 0 2020-07-06T13:19:03.960 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480d56b700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f480818b170 con 0 2020-07-06T13:19:03.960 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f47f8000bf0 con 0x7f48080a31e0 2020-07-06T13:19:03.960 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f47f8001a40 con 0x7f48080a31e0 2020-07-06T13:19:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f47f8004540 con 0x7f48080a31e0 2020-07-06T13:19:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.939 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f47f8005ce0 con 0x7f48080a31e0 2020-07-06T13:19:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.947 7f480d56b700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480807adc0 con 0 2020-07-06T13:19:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:03.951 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f480807adc0 con 0x7f48080a31e0 2020-07-06T13:19:04.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.043 7f480d56b700 1 -- 172.21.15.118:0/4264209647 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4808073130 con 0 2020-07-06T13:19:04.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.043 7f480556e700 1 -- 172.21.15.118:0/4264209647 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+65 (3730786198 0 590078407) 0x7f47f8004020 con 0x7f48080a31e0 2020-07-06T13:19:04.044 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:04.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 >> 172.21.15.118:6800/9723 conn(0x7f47ec006ed0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-07-06T13:19:04.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 >> 172.21.15.118:6789/0 conn(0x7f48080a31e0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-07-06T13:19:04.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 shutdown_connections 2020-07-06T13:19:04.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 shutdown_connections 2020-07-06T13:19:04.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 wait complete. 2020-07-06T13:19:04.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.047 7f480d56b700 1 -- 172.21.15.118:0/4264209647 >> 172.21.15.118:0/4264209647 conn(0x7f4808099440 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.054 INFO:teuthology.orchestra.run.smithi118.stdout:{"checks":{},"status":"HEALTH_OK","overall_status":"HEALTH_WARN"} 2020-07-06T13:19:04.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-07-06T13:19:04.056 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:19:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 Processor -- start 2020-07-06T13:19:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- - start start 2020-07-06T13:19:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c14ba80 con 0 2020-07-06T13:19:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c14be20 con 0 2020-07-06T13:19:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98b7fe700 1 -- 172.21.15.118:0/241815330 learned_addr learned my addr 172.21.15.118:0/241815330 2020-07-06T13:19:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe9800022a0 con 0x7fe98c14b340 2020-07-06T13:19:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3448112597 0 0) 0x7fe980002620 con 0x7fe98c14b340 2020-07-06T13:19:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe978002a20 con 0 2020-07-06T13:19:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe97c003630 con 0x7fe98c148040 2020-07-06T13:19:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2897230533 0 0) 0x7fe97c003930 con 0x7fe98c148040 2020-07-06T13:19:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe9780046c0 con 0 2020-07-06T13:19:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (822825497 0 0) 0x7fe980002bf0 con 0x7fe98c14b340 2020-07-06T13:19:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 >> 172.21.15.118:6789/0 conn(0x7fe98c148040 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-07-06T13:19:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c07a7e0 con 0 2020-07-06T13:19:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe98c116df0 con 0x7fe98c14b340 2020-07-06T13:19:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe98a7fc700 1 -- 172.21.15.118:0/241815330 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe980001050 con 0x7fe98c14b340 2020-07-06T13:19:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- 172.21.15.118:0/241815330 >> 172.21.15.118:6791/0 conn(0x7fe98c14b340 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-07-06T13:19:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- 172.21.15.118:0/241815330 shutdown_connections 2020-07-06T13:19:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- 172.21.15.118:0/241815330 shutdown_connections 2020-07-06T13:19:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- 172.21.15.118:0/241815330 wait complete. 2020-07-06T13:19:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.147 7fe991861700 1 -- 172.21.15.118:0/241815330 >> 172.21.15.118:0/241815330 conn(0x7fe98c143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe991861700 1 Processor -- start 2020-07-06T13:19:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe991861700 1 -- - start start 2020-07-06T13:19:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe991861700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c0a3d20 con 0 2020-07-06T13:19:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe991861700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c0a3490 con 0 2020-07-06T13:19:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe98b7fe700 1 -- 172.21.15.118:0/3250171618 learned_addr learned my addr 172.21.15.118:0/3250171618 2020-07-06T13:19:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe980000e50 con 0x7fe98c0a50e0 2020-07-06T13:19:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2462438403 0 0) 0x7fe980001ff0 con 0x7fe98c0a50e0 2020-07-06T13:19:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe96c002960 con 0 2020-07-06T13:19:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe97c003f60 con 0x7fe98c095bf0 2020-07-06T13:19:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1234238212 0 0) 0x7fe97c003470 con 0x7fe98c095bf0 2020-07-06T13:19:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.151 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe96c004620 con 0 2020-07-06T13:19:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2593781675 0 0) 0x7fe97c003980 con 0x7fe98c095bf0 2020-07-06T13:19:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe96c002ee0 con 0 2020-07-06T13:19:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1842660497 0 0) 0x7fe980002440 con 0x7fe98c0a50e0 2020-07-06T13:19:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe96c003540 con 0 2020-07-06T13:19:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1230862576 0 0) 0x7fe97c0010f0 con 0x7fe98c095bf0 2020-07-06T13:19:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 >> 172.21.15.118:6791/0 conn(0x7fe98c0a50e0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-07-06T13:19:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c07aa40 con 0 2020-07-06T13:19:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe991861700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c071120 con 0 2020-07-06T13:19:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe991861700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c0a6b20 con 0 2020-07-06T13:19:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe97c000bf0 con 0x7fe98c095bf0 2020-07-06T13:19:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe97c001520 con 0x7fe98c095bf0 2020-07-06T13:19:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fe97c001970 con 0x7fe98c095bf0 2020-07-06T13:19:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.155 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fe97c004f30 con 0x7fe98c095bf0 2020-07-06T13:19:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.159 7fe991861700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c07adc0 con 0 2020-07-06T13:19:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.163 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe98c07adc0 con 0x7fe98c095bf0 2020-07-06T13:19:04.258 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe98c156340 con 0 2020-07-06T13:19:04.259 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe988ff9700 1 -- 172.21.15.118:0/3250171618 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 3588361204) 0x7fe97c004260 con 0x7fe98c095bf0 2020-07-06T13:19:04.259 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:04.259 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:18:59.764319","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:19:04.260 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 >> 172.21.15.118:6800/9723 conn(0x7fe96c006ed0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-07-06T13:19:04.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 >> 172.21.15.118:6789/0 conn(0x7fe98c095bf0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-07-06T13:19:04.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 shutdown_connections 2020-07-06T13:19:04.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 shutdown_connections 2020-07-06T13:19:04.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 wait complete. 2020-07-06T13:19:04.261 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.259 7fe991861700 1 -- 172.21.15.118:0/3250171618 >> 172.21.15.118:0/3250171618 conn(0x7fe98c099440 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-06 13:18:56.457152', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2020-07-06 13:18:56.782594', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-06T13:19:04.270 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:19:04.352 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:04.361 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.359 7f8d26534700 1 Processor -- start 2020-07-06T13:19:04.361 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.359 7f8d26534700 1 -- - start start 2020-07-06T13:19:04.362 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2014ba70 con 0 2020-07-06T13:19:04.362 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2014be10 con 0 2020-07-06T13:19:04.362 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1ffff700 1 -- 172.21.15.118:0/2443895901 learned_addr learned my addr 172.21.15.118:0/2443895901 2020-07-06T13:19:04.364 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d18003630 con 0x7f8d20148030 2020-07-06T13:19:04.364 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1746332650 0 0) 0x7f8d180039b0 con 0x7f8d20148030 2020-07-06T13:19:04.364 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d00002a20 con 0 2020-07-06T13:19:04.364 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d080022a0 con 0x7f8d2014b330 2020-07-06T13:19:04.364 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (593609308 0 0) 0x7f8d080025a0 con 0x7f8d2014b330 2020-07-06T13:19:04.365 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d000046c0 con 0 2020-07-06T13:19:04.365 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (210761562 0 0) 0x7f8d08002a40 con 0x7f8d2014b330 2020-07-06T13:19:04.365 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 >> 172.21.15.118:6789/0 conn(0x7f8d20148030 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-07-06T13:19:04.365 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2007a900 con 0 2020-07-06T13:19:04.366 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8d20116de0 con 0x7f8d2014b330 2020-07-06T13:19:04.366 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1effd700 1 -- 172.21.15.118:0/2443895901 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d08000e50 con 0x7f8d2014b330 2020-07-06T13:19:04.366 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- 172.21.15.118:0/2443895901 >> 172.21.15.118:6790/0 conn(0x7f8d2014b330 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-07-06T13:19:04.366 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- 172.21.15.118:0/2443895901 shutdown_connections 2020-07-06T13:19:04.366 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- 172.21.15.118:0/2443895901 shutdown_connections 2020-07-06T13:19:04.367 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- 172.21.15.118:0/2443895901 wait complete. 2020-07-06T13:19:04.367 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- 172.21.15.118:0/2443895901 >> 172.21.15.118:0/2443895901 conn(0x7f8d20143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.369 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 Processor -- start 2020-07-06T13:19:04.369 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- - start start 2020-07-06T13:19:04.370 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200a3d50 con 0 2020-07-06T13:19:04.370 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d26534700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200a6b20 con 0 2020-07-06T13:19:04.370 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.363 7f8d1ffff700 1 -- 172.21.15.118:0/3507183826 learned_addr learned my addr 172.21.15.118:0/3507183826 2020-07-06T13:19:04.370 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d18003440 con 0x7f8d200a3360 2020-07-06T13:19:04.371 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2812662829 0 0) 0x7f8d18003700 con 0x7f8d200a3360 2020-07-06T13:19:04.371 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d04002960 con 0 2020-07-06T13:19:04.371 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d08002a40 con 0x7f8d200a6370 2020-07-06T13:19:04.371 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4137993039 0 0) 0x7f8d08002080 con 0x7f8d200a6370 2020-07-06T13:19:04.371 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d04004620 con 0 2020-07-06T13:19:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3660774472 0 0) 0x7f8d18000e50 con 0x7f8d200a3360 2020-07-06T13:19:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d04002ee0 con 0 2020-07-06T13:19:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (380148051 0 0) 0x7f8d08002410 con 0x7f8d200a6370 2020-07-06T13:19:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d04003540 con 0 2020-07-06T13:19:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (749604437 0 0) 0x7f8d08001610 con 0x7f8d200a6370 2020-07-06T13:19:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 >> 172.21.15.118:6789/0 conn(0x7f8d200a3360 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-07-06T13:19:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2007ab60 con 0 2020-07-06T13:19:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d26534700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d20072ba0 con 0 2020-07-06T13:19:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d26534700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2018b160 con 0 2020-07-06T13:19:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8d08000bf0 con 0x7f8d200a6370 2020-07-06T13:19:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8d08001a40 con 0x7f8d200a6370 2020-07-06T13:19:04.380 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f8d080033c0 con 0x7f8d200a6370 2020-07-06T13:19:04.380 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f8d080036a0 con 0x7f8d200a6370 2020-07-06T13:19:04.380 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.367 7f8d26534700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf8002050 con 0 2020-07-06T13:19:04.382 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.371 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8d080030b0 con 0x7f8d200a6370 2020-07-06T13:19:04.456 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.455 7f8d26534700 1 -- 172.21.15.118:0/3507183826 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8cf8001250 con 0 2020-07-06T13:19:04.457 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d1d7fa700 1 -- 172.21.15.118:0/3507183826 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7f8d08003be0 con 0x7f8d200a6370 2020-07-06T13:19:04.458 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:04.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 >> 172.21.15.118:6800/9723 conn(0x7f8d04006e70 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-07-06T13:19:04.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 >> 172.21.15.118:6791/0 conn(0x7f8d200a6370 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-07-06T13:19:04.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 shutdown_connections 2020-07-06T13:19:04.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 shutdown_connections 2020-07-06T13:19:04.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 wait complete. 2020-07-06T13:19:04.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.459 7f8d26534700 1 -- 172.21.15.118:0/3507183826 >> 172.21.15.118:0/3507183826 conn(0x7f8d200994d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.469 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-06T13:19:04.553 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:04.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3e7791700 1 Processor -- start 2020-07-06T13:19:04.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3e7791700 1 -- - start start 2020-07-06T13:19:04.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3e7791700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e014ba80 con 0 2020-07-06T13:19:04.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3e7791700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e014be20 con 0 2020-07-06T13:19:04.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3e57b7700 1 -- 172.21.15.118:0/3677993072 learned_addr learned my addr 172.21.15.118:0/3677993072 2020-07-06T13:19:04.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d00022a0 con 0x7fb3e014b340 2020-07-06T13:19:04.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4198435380 0 0) 0x7fb3d0002620 con 0x7fb3e014b340 2020-07-06T13:19:04.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb3c4002a20 con 0 2020-07-06T13:19:04.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d80039b0 con 0x7fb3e0148040 2020-07-06T13:19:04.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1419389530 0 0) 0x7fb3d8003cb0 con 0x7fb3e0148040 2020-07-06T13:19:04.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.563 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb3c40046c0 con 0 2020-07-06T13:19:04.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1913226016 0 0) 0x7fb3d8004150 con 0x7fb3e0148040 2020-07-06T13:19:04.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 >> 172.21.15.118:6789/0 conn(0x7fb3e014b340 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-07-06T13:19:04.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e007a910 con 0 2020-07-06T13:19:04.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb3e00e9f60 con 0x7fb3e0148040 2020-07-06T13:19:04.568 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3d7fff700 1 -- 172.21.15.118:0/3677993072 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d80011d0 con 0x7fb3e0148040 2020-07-06T13:19:04.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- 172.21.15.118:0/3677993072 >> 172.21.15.118:6790/0 conn(0x7fb3e0148040 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-07-06T13:19:04.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- 172.21.15.118:0/3677993072 shutdown_connections 2020-07-06T13:19:04.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- 172.21.15.118:0/3677993072 shutdown_connections 2020-07-06T13:19:04.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- 172.21.15.118:0/3677993072 wait complete. 2020-07-06T13:19:04.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- 172.21.15.118:0/3677993072 >> 172.21.15.118:0/3677993072 conn(0x7fb3e0143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 Processor -- start 2020-07-06T13:19:04.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- - start start 2020-07-06T13:19:04.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00a3d40 con 0 2020-07-06T13:19:04.572 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.567 7fb3e7791700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00a6b10 con 0 2020-07-06T13:19:04.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3e57b7700 1 -- 172.21.15.118:0/1993723188 learned_addr learned my addr 172.21.15.118:0/1993723188 2020-07-06T13:19:04.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d8004150 con 0x7fb3e00a3350 2020-07-06T13:19:04.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1560443337 0 0) 0x7fb3d8003790 con 0x7fb3e00a3350 2020-07-06T13:19:04.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb3c8002960 con 0 2020-07-06T13:19:04.573 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d00020b0 con 0x7fb3e00a6360 2020-07-06T13:19:04.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3060194887 0 0) 0x7fb3d0002370 con 0x7fb3e00a6360 2020-07-06T13:19:04.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb3c8004620 con 0 2020-07-06T13:19:04.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2156423792 0 0) 0x7fb3d80016f0 con 0x7fb3e00a3350 2020-07-06T13:19:04.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb3c8002ee0 con 0 2020-07-06T13:19:04.574 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1246028661 0 0) 0x7fb3d0000e50 con 0x7fb3e00a6360 2020-07-06T13:19:04.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb3c8003540 con 0 2020-07-06T13:19:04.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2451036976 0 0) 0x7fb3d8001c00 con 0x7fb3e00a3350 2020-07-06T13:19:04.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 >> 172.21.15.118:6791/0 conn(0x7fb3e00a6360 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-07-06T13:19:04.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e007ab70 con 0 2020-07-06T13:19:04.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e00712c0 con 0 2020-07-06T13:19:04.576 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb3d8000f70 con 0x7fb3e00a3350 2020-07-06T13:19:04.576 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fb3d80045e0 con 0x7fb3e00a3350 2020-07-06T13:19:04.576 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e018b150 con 0 2020-07-06T13:19:04.576 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fb3d8004f50 con 0x7fb3e00a3350 2020-07-06T13:19:04.576 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.571 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7fb3d8005230 con 0x7fb3e00a3350 2020-07-06T13:19:04.577 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.579 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e007af10 con 0 2020-07-06T13:19:04.581 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.583 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb3e007af10 con 0x7fb3e00a3350 2020-07-06T13:19:04.674 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb3e0073300 con 0 2020-07-06T13:19:04.675 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3d67fc700 1 -- 172.21.15.118:0/1993723188 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7fb3d8004a30 con 0x7fb3e00a3350 2020-07-06T13:19:04.675 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:04.676 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 >> 172.21.15.118:6800/9723 conn(0x7fb3c8006400 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-07-06T13:19:04.676 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 >> 172.21.15.118:6790/0 conn(0x7fb3e00a3350 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-07-06T13:19:04.677 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 shutdown_connections 2020-07-06T13:19:04.677 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 shutdown_connections 2020-07-06T13:19:04.677 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 wait complete. 2020-07-06T13:19:04.677 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.675 7fb3e7791700 1 -- 172.21.15.118:0/1993723188 >> 172.21.15.118:0/1993723188 conn(0x7fb3e0099590 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.686 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-06T13:19:04.770 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:04.779 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab8e54700 1 Processor -- start 2020-07-06T13:19:04.780 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab8e54700 1 -- - start start 2020-07-06T13:19:04.782 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab8e54700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab414ba80 con 0 2020-07-06T13:19:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab8e54700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab414be20 con 0 2020-07-06T13:19:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6aabfff700 1 -- 172.21.15.118:0/4001683901 learned_addr learned my addr 172.21.15.118:0/4001683901 2020-07-06T13:19:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6a9c003630 con 0x7f6ab414b340 2020-07-06T13:19:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3683553860 0 0) 0x7f6a9c0039b0 con 0x7f6ab414b340 2020-07-06T13:19:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6a94002a20 con 0 2020-07-06T13:19:04.785 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6aa40022a0 con 0x7f6ab4148040 2020-07-06T13:19:04.785 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3846028454 0 0) 0x7f6aa40025a0 con 0x7f6ab4148040 2020-07-06T13:19:04.785 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6a940046b0 con 0 2020-07-06T13:19:04.786 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3285114391 0 0) 0x7f6a9c003f80 con 0x7f6ab414b340 2020-07-06T13:19:04.786 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 >> 172.21.15.118:6789/0 conn(0x7f6ab4148040 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-07-06T13:19:04.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.779 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab407a910 con 0 2020-07-06T13:19:04.787 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6ab4116df0 con 0x7f6ab414b340 2020-07-06T13:19:04.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab2570700 1 -- 172.21.15.118:0/4001683901 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6a9c001050 con 0x7f6ab414b340 2020-07-06T13:19:04.788 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- 172.21.15.118:0/4001683901 >> 172.21.15.118:6790/0 conn(0x7f6ab414b340 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-07-06T13:19:04.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- 172.21.15.118:0/4001683901 shutdown_connections 2020-07-06T13:19:04.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- 172.21.15.118:0/4001683901 shutdown_connections 2020-07-06T13:19:04.789 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- 172.21.15.118:0/4001683901 wait complete. 2020-07-06T13:19:04.790 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- 172.21.15.118:0/4001683901 >> 172.21.15.118:0/4001683901 conn(0x7f6ab4143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 Processor -- start 2020-07-06T13:19:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- - start start 2020-07-06T13:19:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40a3d40 con 0 2020-07-06T13:19:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab8e54700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40a6b10 con 0 2020-07-06T13:19:04.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab2d71700 1 -- 172.21.15.118:0/2583748848 learned_addr learned my addr 172.21.15.118:0/2583748848 2020-07-06T13:19:04.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6a9c000e50 con 0x7f6ab40a6360 2020-07-06T13:19:04.795 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3469033246 0 0) 0x7f6a9c001570 con 0x7f6ab40a6360 2020-07-06T13:19:04.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6a98002960 con 0 2020-07-06T13:19:04.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6aa40020b0 con 0x7f6ab40a3350 2020-07-06T13:19:04.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3672739698 0 0) 0x7f6aa40023b0 con 0x7f6ab40a3350 2020-07-06T13:19:04.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.783 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6a98004620 con 0 2020-07-06T13:19:04.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3508849989 0 0) 0x7f6a9c0019c0 con 0x7f6ab40a6360 2020-07-06T13:19:04.797 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6a98002ee0 con 0 2020-07-06T13:19:04.798 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (432485455 0 0) 0x7f6aa4000e50 con 0x7f6ab40a3350 2020-07-06T13:19:04.798 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6a98003540 con 0 2020-07-06T13:19:04.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3497601134 0 0) 0x7f6a9c003620 con 0x7f6ab40a6360 2020-07-06T13:19:04.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 >> 172.21.15.118:6790/0 conn(0x7f6ab40a3350 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-07-06T13:19:04.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab407ab70 con 0 2020-07-06T13:19:04.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab40712c0 con 0 2020-07-06T13:19:04.802 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab418b150 con 0 2020-07-06T13:19:04.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6a9c000bf0 con 0x7f6ab40a6360 2020-07-06T13:19:04.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6a9c003a50 con 0x7f6ab40a6360 2020-07-06T13:19:04.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f6a9c004660 con 0x7f6ab40a6360 2020-07-06T13:19:04.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.787 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f6a9c005fe0 con 0x7f6ab40a6360 2020-07-06T13:19:04.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.795 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c002050 con 0 2020-07-06T13:19:04.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.795 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6a9c004bd0 con 0x7f6ab40a6360 2020-07-06T13:19:04.886 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f6a8c001280 con 0 2020-07-06T13:19:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab0d6d700 1 -- 172.21.15.118:0/2583748848 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f6a9c0042b0 con 0x7f6ab40a6360 2020-07-06T13:19:04.887 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:04.888 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 >> 172.21.15.118:6800/9723 conn(0x7f6a98006ed0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-07-06T13:19:04.889 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 >> 172.21.15.118:6789/0 conn(0x7f6ab40a6360 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-07-06T13:19:04.889 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 shutdown_connections 2020-07-06T13:19:04.889 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 shutdown_connections 2020-07-06T13:19:04.889 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 wait complete. 2020-07-06T13:19:04.890 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.887 7f6ab8e54700 1 -- 172.21.15.118:0/2583748848 >> 172.21.15.118:0/2583748848 conn(0x7f6ab4099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:04.899 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:19:04.985 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:04.991 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.991 7f8ac16f7700 1 Processor -- start 2020-07-06T13:19:04.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.991 7f8ac16f7700 1 -- - start start 2020-07-06T13:19:04.992 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.991 7f8ac16f7700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc14ba90 con 0 2020-07-06T13:19:04.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.991 7f8ac16f7700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc14be30 con 0 2020-07-06T13:19:04.993 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.991 7f8ab2d71700 1 -- 172.21.15.118:0/3019773061 learned_addr learned my addr 172.21.15.118:0/3019773061 2020-07-06T13:19:04.994 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aac0022a0 con 0x7f8abc148050 2020-07-06T13:19:04.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4074152707 0 0) 0x7f8aac002620 con 0x7f8abc148050 2020-07-06T13:19:04.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8a9c002a20 con 0 2020-07-06T13:19:04.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aa4003630 con 0x7f8abc14b350 2020-07-06T13:19:04.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4152931029 0 0) 0x7f8aa40039b0 con 0x7f8abc14b350 2020-07-06T13:19:04.995 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8a9c0046c0 con 0 2020-07-06T13:19:04.996 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4128188612 0 0) 0x7f8aac002bf0 con 0x7f8abc148050 2020-07-06T13:19:04.996 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 >> 172.21.15.118:6789/0 conn(0x7f8abc14b350 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-07-06T13:19:04.996 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc07a7f0 con 0 2020-07-06T13:19:04.996 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8abc0e9f70 con 0x7f8abc148050 2020-07-06T13:19:04.996 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8abad71700 1 -- 172.21.15.118:0/3019773061 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aac001050 con 0x7f8abc148050 2020-07-06T13:19:04.997 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8ac16f7700 1 -- 172.21.15.118:0/3019773061 >> 172.21.15.118:6791/0 conn(0x7f8abc148050 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-07-06T13:19:04.999 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8ac16f7700 1 -- 172.21.15.118:0/3019773061 shutdown_connections 2020-07-06T13:19:05.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8ac16f7700 1 -- 172.21.15.118:0/3019773061 shutdown_connections 2020-07-06T13:19:05.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8ac16f7700 1 -- 172.21.15.118:0/3019773061 wait complete. 2020-07-06T13:19:05.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.995 7f8ac16f7700 1 -- 172.21.15.118:0/3019773061 >> 172.21.15.118:0/3019773061 conn(0x7f8abc143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:05.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 Processor -- start 2020-07-06T13:19:05.000 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 -- - start start 2020-07-06T13:19:05.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0a3c80 con 0 2020-07-06T13:19:05.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc095cb0 con 0 2020-07-06T13:19:05.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8abb572700 1 -- 172.21.15.118:0/3008899863 learned_addr learned my addr 172.21.15.118:0/3008899863 2020-07-06T13:19:05.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aac001010 con 0x7f8abc0a3290 2020-07-06T13:19:05.001 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3995101467 0 0) 0x7f8aac002070 con 0x7f8abc0a3290 2020-07-06T13:19:05.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8aa0002960 con 0 2020-07-06T13:19:05.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aa4003ef0 con 0x7f8abc0a5040 2020-07-06T13:19:05.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (420754215 0 0) 0x7f8aa4003470 con 0x7f8abc0a5040 2020-07-06T13:19:05.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8aa0004620 con 0 2020-07-06T13:19:05.002 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2915833728 0 0) 0x7f8aac0025e0 con 0x7f8abc0a3290 2020-07-06T13:19:05.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8aa0002ee0 con 0 2020-07-06T13:19:05.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3822341403 0 0) 0x7f8aa40038d0 con 0x7f8abc0a5040 2020-07-06T13:19:05.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8aa0003540 con 0 2020-07-06T13:19:05.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (329280215 0 0) 0x7f8aac001900 con 0x7f8abc0a3290 2020-07-06T13:19:05.003 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 >> 172.21.15.118:6790/0 conn(0x7f8abc0a5040 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc07aa50 con 0 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc0b2780 con 0 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc0a6a30 con 0 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8aac001360 con 0x7f8abc0a3290 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8aac002ed0 con 0x7f8abc0a3290 2020-07-06T13:19:05.004 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f8aac003630 con 0x7f8abc0a3290 2020-07-06T13:19:05.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:04.999 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f8aac006370 con 0x7f8abc0a3290 2020-07-06T13:19:05.005 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.003 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a94002050 con 0 2020-07-06T13:19:05.009 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.007 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8aac003110 con 0x7f8abc0a3290 2020-07-06T13:19:05.098 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a94001180 con 0 2020-07-06T13:19:05.098 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ab956e700 1 -- 172.21.15.118:0/3008899863 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2249 (3889722134 0 1807376833) 0x7f8aac006610 con 0x7f8abc0a3290 2020-07-06T13:19:05.099 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2020-07-06T13:19:05.099 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:05.100 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:19:00.768971","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:19:05.100 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 >> 172.21.15.118:6800/9723 conn(0x7f8aa00064e0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-07-06T13:19:05.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 >> 172.21.15.118:6789/0 conn(0x7f8abc0a3290 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-07-06T13:19:05.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 shutdown_connections 2020-07-06T13:19:05.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 shutdown_connections 2020-07-06T13:19:05.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 wait complete. 2020-07-06T13:19:05.101 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.099 7f8ac16f7700 1 -- 172.21.15.118:0/3008899863 >> 172.21.15.118:0/3008899863 conn(0x7f8abc099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:05.416 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-06 13:18:57.751069', 'modified': '2020-07-06 13:19:00.768971', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4211': {'gid': 4211, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.118:6819/1597074397', 'standby_for_rank': -1, 'standby_for_fscid': -1, 'standby_for_name': '', 'standby_replay': False, 'export_targets': [], 'features': 4611087854031667195}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-06T13:19:05.416 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-06T13:19:05.417 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-07-06T13:19:05.502 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","whoami":0,"id":4211,"want_state":"up:active","state":"up:active","rank_uptime":5.735971,"mdsmap_epoch":6,"osdmap_epoch":16,"osdmap_epoch_barrier":16,"uptime":6.156089} 2020-07-06T13:19:05.509 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "74e2240b-47f9-4a3f-ade9-f9f65278ae84", "id": 4211, "mdsmap_epoch": 6, "osdmap_epoch": 16, "osdmap_epoch_barrier": 16, "rank_uptime": 5.735971, "state": "up:active", "uptime": 6.156089, "want_state": "up:active", "whoami": 0 } 2020-07-06T13:19:05.509 INFO:teuthology.run_tasks:Running task exec... 2020-07-06T13:19:05.522 INFO:teuthology.task.exec:Executing custom commands... 2020-07-06T13:19:05.523 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:19:05.523 INFO:teuthology.orchestra.run.smithi118:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release mimic' 2020-07-06T13:19:05.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e0df80700 1 Processor -- start 2020-07-06T13:19:05.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e0df80700 1 -- - start start 2020-07-06T13:19:05.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e0df80700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0814bb80 con 0 2020-07-06T13:19:05.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e0df80700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0814bf20 con 0 2020-07-06T13:19:05.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e06ffd700 1 -- 172.21.15.118:0/2802879609 learned_addr learned my addr 172.21.15.118:0/2802879609 2020-07-06T13:19:05.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dfc0035b0 con 0x7f7e0814b3f0 2020-07-06T13:19:05.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2168113652 0 0) 0x7f7dfc003930 con 0x7f7e0814b3f0 2020-07-06T13:19:05.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7df4002a20 con 0 2020-07-06T13:19:05.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7df80022a0 con 0x7f7e081480f0 2020-07-06T13:19:05.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2087043202 0 0) 0x7f7df80025a0 con 0x7f7e081480f0 2020-07-06T13:19:05.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7df40046c0 con 0 2020-07-06T13:19:05.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2154538850 0 0) 0x7f7dfc003eb0 con 0x7f7e0814b3f0 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 >> 172.21.15.118:6790/0 conn(0x7f7e081480f0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.615 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0807aa00 con 0 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7e08116ea0 con 0x7f7e0814b3f0 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e067fc700 1 -- 172.21.15.118:0/2802879609 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dfc001010 con 0x7f7e0814b3f0 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e0df80700 1 -- 172.21.15.118:0/2802879609 >> 172.21.15.118:6789/0 conn(0x7f7e0814b3f0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-07-06T13:19:05.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e0df80700 1 -- 172.21.15.118:0/2802879609 shutdown_connections 2020-07-06T13:19:05.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e0df80700 1 -- 172.21.15.118:0/2802879609 shutdown_connections 2020-07-06T13:19:05.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e0df80700 1 -- 172.21.15.118:0/2802879609 wait complete. 2020-07-06T13:19:05.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.619 7f7e0df80700 1 -- 172.21.15.118:0/2802879609 >> 172.21.15.118:0/2802879609 conn(0x7f7e08144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:05.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 Processor -- start 2020-07-06T13:19:05.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 -- - start start 2020-07-06T13:19:05.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080a3d80 con 0 2020-07-06T13:19:05.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080a6b00 con 0 2020-07-06T13:19:05.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e077fe700 1 -- 172.21.15.118:0/3170288302 learned_addr learned my addr 172.21.15.118:0/3170288302 2020-07-06T13:19:05.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7df80020e0 con 0x7f7e080a3370 2020-07-06T13:19:05.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (927386875 0 0) 0x7f7df80023e0 con 0x7f7e080a3370 2020-07-06T13:19:05.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7de8002960 con 0 2020-07-06T13:19:05.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7dfc000e50 con 0x7f7e080a6350 2020-07-06T13:19:05.625 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2861866295 0 0) 0x7f7dfc003300 con 0x7f7e080a6350 2020-07-06T13:19:05.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7de8004620 con 0 2020-07-06T13:19:05.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (725049188 0 0) 0x7f7df8000e50 con 0x7f7e080a3370 2020-07-06T13:19:05.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7de8002ee0 con 0 2020-07-06T13:19:05.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2822974811 0 0) 0x7f7dfc003680 con 0x7f7e080a6350 2020-07-06T13:19:05.626 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7de8003540 con 0 2020-07-06T13:19:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2733427175 0 0) 0x7f7df80014e0 con 0x7f7e080a3370 2020-07-06T13:19:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 >> 172.21.15.118:6791/0 conn(0x7f7e080a6350 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-07-06T13:19:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0807ac60 con 0 2020-07-06T13:19:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e080b29e0 con 0 2020-07-06T13:19:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0818b2a0 con 0 2020-07-06T13:19:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7e080ea010 con 0x7f7e080a3370 2020-07-06T13:19:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7df8001910 con 0x7f7e080a3370 2020-07-06T13:19:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f7df8001b50 con 0x7f7e080a3370 2020-07-06T13:19:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.623 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7f7df8005d30 con 0x7f7e080a3370 2020-07-06T13:19:05.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.631 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4002050 con 0 2020-07-06T13:19:05.634 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.635 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f7df8004640 con 0x7f7e080a3370 2020-07-06T13:19:05.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.727 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 --> 172.21.15.118:6790/0 -- mon_command({"release": "mimic", "prefix": "osd require-osd-release"} v 0) v1 -- 0x7f7de4001280 con 0 2020-07-06T13:19:05.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.727 7f7e04ff9700 1 -- 172.21.15.118:0/3170288302 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"release": "mimic", "prefix": "osd require-osd-release"}]=0 v16) v1 ==== 91+0+0 (3431819307 0 0) 0x7f7df8004900 con 0x7f7e080a3370 2020-07-06T13:19:05.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 >> 172.21.15.118:6800/9723 conn(0x7f7de8006e70 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-07-06T13:19:05.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 >> 172.21.15.118:6790/0 conn(0x7f7e080a3370 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-07-06T13:19:05.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 shutdown_connections 2020-07-06T13:19:05.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 shutdown_connections 2020-07-06T13:19:05.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 wait complete. 2020-07-06T13:19:05.733 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.731 7f7e0df80700 1 -- 172.21.15.118:0/3170288302 >> 172.21.15.118:0/3170288302 conn(0x7f7e08099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:05.741 INFO:teuthology.orchestra.run.smithi118:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client mimic' 2020-07-06T13:19:05.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff87c5a700 1 Processor -- start 2020-07-06T13:19:05.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff87c5a700 1 -- - start start 2020-07-06T13:19:05.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff87c5a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8014bb40 con 0 2020-07-06T13:19:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff87c5a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8014bee0 con 0 2020-07-06T13:19:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff8547f700 1 -- 172.21.15.118:0/73660906 learned_addr learned my addr 172.21.15.118:0/73660906 2020-07-06T13:19:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff6c003630 con 0x7eff8014b400 2020-07-06T13:19:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2168827614 0 0) 0x7eff6c0039b0 con 0x7eff8014b400 2020-07-06T13:19:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7eff64002a20 con 0 2020-07-06T13:19:05.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff74002620 con 0x7eff80148100 2020-07-06T13:19:05.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2170001480 0 0) 0x7eff74002920 con 0x7eff80148100 2020-07-06T13:19:05.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7eff640046c0 con 0 2020-07-06T13:19:05.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2605168550 0 0) 0x7eff6c003f80 con 0x7eff8014b400 2020-07-06T13:19:05.834 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 >> 172.21.15.118:6790/0 conn(0x7eff80148100 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-07-06T13:19:05.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8007aa10 con 0 2020-07-06T13:19:05.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7eff80116eb0 con 0x7eff8014b400 2020-07-06T13:19:05.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff84c7e700 1 -- 172.21.15.118:0/73660906 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff6c001050 con 0x7eff8014b400 2020-07-06T13:19:05.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.831 7eff87c5a700 1 -- 172.21.15.118:0/73660906 >> 172.21.15.118:6791/0 conn(0x7eff8014b400 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-07-06T13:19:05.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- 172.21.15.118:0/73660906 shutdown_connections 2020-07-06T13:19:05.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- 172.21.15.118:0/73660906 shutdown_connections 2020-07-06T13:19:05.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- 172.21.15.118:0/73660906 wait complete. 2020-07-06T13:19:05.837 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- 172.21.15.118:0/73660906 >> 172.21.15.118:0/73660906 conn(0x7eff80144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:05.837 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 Processor -- start 2020-07-06T13:19:05.837 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- - start start 2020-07-06T13:19:05.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800a3f50 con 0 2020-07-06T13:19:05.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.835 7eff87c5a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800a5470 con 0 2020-07-06T13:19:05.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff85c80700 1 -- 172.21.15.118:0/2217993163 learned_addr learned my addr 172.21.15.118:0/2217993163 2020-07-06T13:19:05.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff6c000e50 con 0x7eff80095da0 2020-07-06T13:19:05.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2904970384 0 0) 0x7eff6c003380 con 0x7eff80095da0 2020-07-06T13:19:05.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7eff68002960 con 0 2020-07-06T13:19:05.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff74002460 con 0x7eff800a3560 2020-07-06T13:19:05.841 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2197028264 0 0) 0x7eff74002760 con 0x7eff800a3560 2020-07-06T13:19:05.841 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7eff68004620 con 0 2020-07-06T13:19:05.841 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1646927766 0 0) 0x7eff740029d0 con 0x7eff800a3560 2020-07-06T13:19:05.841 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff68002ee0 con 0 2020-07-06T13:19:05.841 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3585313368 0 0) 0x7eff6c0037d0 con 0x7eff80095da0 2020-07-06T13:19:05.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff68003540 con 0 2020-07-06T13:19:05.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3317156101 0 0) 0x7eff74001470 con 0x7eff800a3560 2020-07-06T13:19:05.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 >> 172.21.15.118:6790/0 conn(0x7eff80095da0 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-07-06T13:19:05.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8007ac70 con 0 2020-07-06T13:19:05.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7eff800ea020 con 0x7eff800a3560 2020-07-06T13:19:05.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7eff740018a0 con 0x7eff800a3560 2020-07-06T13:19:05.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800714b0 con 0 2020-07-06T13:19:05.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800a6da0 con 0 2020-07-06T13:19:05.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7eff74001e00 con 0x7eff800a3560 2020-07-06T13:19:05.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.839 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2050079546 0 0) 0x7eff740050d0 con 0x7eff800a3560 2020-07-06T13:19:05.844 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.843 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8007afd0 con 0 2020-07-06T13:19:05.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.847 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7eff8007afd0 con 0x7eff800a3560 2020-07-06T13:19:05.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:05.939 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "mimic"} v 0) v1 -- 0x7eff800ba450 con 0 2020-07-06T13:19:06.800 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.799 7eff7effd700 1 -- 172.21.15.118:0/2217993163 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "mimic"}]=0 set require_min_compat_client to mimic v17) v1 ==== 139+0+0 (4159765547 0 0) 0x7eff74004470 con 0x7eff800a3560 2020-07-06T13:19:06.804 INFO:teuthology.orchestra.run.smithi118.stderr:set require_min_compat_client to mimic 2020-07-06T13:19:06.806 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 >> 172.21.15.118:6800/9723 conn(0x7eff68006ec0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-07-06T13:19:06.806 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 >> 172.21.15.118:6791/0 conn(0x7eff800a3560 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-07-06T13:19:06.807 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 shutdown_connections 2020-07-06T13:19:06.807 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 shutdown_connections 2020-07-06T13:19:06.807 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 wait complete. 2020-07-06T13:19:06.807 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:06.807 7eff87c5a700 1 -- 172.21.15.118:0/2217993163 >> 172.21.15.118:0/2217993163 conn(0x7eff80099650 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:06.816 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:19:06.830 INFO:teuthology.task.print:**** done ceph 2020-07-06T13:19:06.830 INFO:teuthology.run_tasks:Running task workunit... 2020-07-06T13:19:06.846 INFO:tasks.workunit:Pulling workunits from ref 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:19:06.847 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-07-06T13:19:06.848 INFO:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:06.856 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-07-06T13:19:06.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T13:19:06.857 INFO:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:06.904 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:06.905 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-07-06T13:19:06.952 INFO:tasks.workunit:timeout=3h 2020-07-06T13:19:06.953 INFO:tasks.workunit:cleanup=True 2020-07-06T13:19:06.953 INFO:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:19:07.053 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-07-06T13:19:37.935 INFO:tasks.workunit.client.0.smithi148.stderr:Note: checking out '754758768dacbb43223ce6879371b1e2ab6a4c92'. 2020-07-06T13:19:37.936 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:19:37.936 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-07-06T13:19:37.936 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2020-07-06T13:19:37.936 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by performing another checkout. 2020-07-06T13:19:37.936 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:19:37.937 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2020-07-06T13:19:37.937 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-07-06T13:19:37.937 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:19:37.937 INFO:tasks.workunit.client.0.smithi148.stderr: git checkout -b 2020-07-06T13:19:37.937 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:19:37.938 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 754758768d Merge pull request #35885 from rhcs-dashboard/wip-46313-octopus 2020-07-06T13:19:37.939 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-07-06T13:19:37.946 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-07-06T13:19:37.949 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-07-06T13:19:37.949 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-07-06T13:19:38.666 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-07-06T13:19:38.774 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-07-06T13:19:38.832 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-07-06T13:19:38.835 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-07-06T13:19:38.835 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-07-06T13:19:38.897 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-07-06T13:19:38.949 DEBUG:teuthology.orchestra.remote:smithi148:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-07-06T13:19:38.960 INFO:tasks.workunit:Running workunits matching fs/upgrade/volume_client on client.0... 2020-07-06T13:19:38.961 INFO:tasks.workunit:Running workunit fs/upgrade/volume_client... 2020-07-06T13:19:38.961 INFO:teuthology.orchestra.run.smithi148:workunit test fs/upgrade/volume_client> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=754758768dacbb43223ce6879371b1e2ab6a4c92 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ACTION=create adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/upgrade/volume_client 2020-07-06T13:19:38.974 INFO:tasks.workunit.client.0.smithi148.stderr:+ PYTHON=python2 2020-07-06T13:19:38.974 INFO:tasks.workunit.client.0.smithi148.stderr:+ main create 2020-07-06T13:19:38.975 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' create = create ']' 2020-07-06T13:19:38.975 INFO:tasks.workunit.client.0.smithi148.stderr:+ conf_keys 2020-07-06T13:19:38.975 INFO:tasks.workunit.client.0.smithi148.stderr:+ local client= 2020-07-06T13:19:38.975 INFO:tasks.workunit.client.0.smithi148.stderr:+ ls /etc/ceph 2020-07-06T13:19:38.976 INFO:tasks.workunit.client.0.smithi148.stderr:ceph.client.0.keyring 2020-07-06T13:19:38.976 INFO:tasks.workunit.client.0.smithi148.stderr:ceph.client.1.keyring 2020-07-06T13:19:38.976 INFO:tasks.workunit.client.0.smithi148.stderr:ceph.conf 2020-07-06T13:19:38.977 INFO:tasks.workunit.client.0.smithi148.stderr:ceph.keyring 2020-07-06T13:19:38.977 INFO:tasks.workunit.client.0.smithi148.stderr:rbdmap 2020-07-06T13:19:38.978 INFO:tasks.workunit.client.0.smithi148.stderr:+ ceph auth get-or-create client.manila mds 'allow *' osd 'allow rw' mon 'allow *' 2020-07-06T13:19:38.978 INFO:tasks.workunit.client.0.smithi148.stderr:+ import_key '' /etc/ceph/ceph.keyring 2020-07-06T13:19:38.978 INFO:tasks.workunit.client.0.smithi148.stderr:+ local client= 2020-07-06T13:19:38.979 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /etc/ceph/ceph.keyring ']' 2020-07-06T13:19:38.979 INFO:tasks.workunit.client.0.smithi148.stderr:+ local keyring=/etc/ceph/ceph.keyring 2020-07-06T13:19:38.979 INFO:tasks.workunit.client.0.smithi148.stderr:++ mktemp 2020-07-06T13:19:38.979 INFO:tasks.workunit.client.0.smithi148.stderr:+ local T=/tmp/tmp.xQGOdBaPQN 2020-07-06T13:19:38.980 INFO:tasks.workunit.client.0.smithi148.stderr:+ tee /tmp/tmp.xQGOdBaPQN 2020-07-06T13:19:39.110 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 Processor -- start 2020-07-06T13:19:39.111 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- - start start 2020-07-06T13:19:39.111 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df8154f40 con 0 2020-07-06T13:19:39.112 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df8156290 con 0 2020-07-06T13:19:39.113 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6826700 1 -- 172.21.15.148:0/1514611532 learned_addr learned my addr 172.21.15.148:0/1514611532 2020-07-06T13:19:39.113 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1de8003680 con 0x7f1df81517e0 2020-07-06T13:19:39.113 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2867392531 0 0) 0x7f1de8003a00 con 0x7f1df81517e0 2020-07-06T13:19:39.114 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1de4002a20 con 0 2020-07-06T13:19:39.114 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1dec0022a0 con 0x7f1df814e8f0 2020-07-06T13:19:39.114 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3731057109 0 0) 0x7f1dec0025a0 con 0x7f1df814e8f0 2020-07-06T13:19:39.114 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1de40046c0 con 0 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2237665288 0 0) 0x7f1dec002a40 con 0x7f1df814e8f0 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 >> 172.21.15.118:6790/0 conn(0x7f1df81517e0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df807a950 con 0 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1df80e9fa0 con 0x7f1df814e8f0 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1df6025700 1 -- 172.21.15.148:0/1514611532 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1dec000e50 con 0x7f1df814e8f0 2020-07-06T13:19:39.115 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- 172.21.15.148:0/1514611532 >> 172.21.15.118:6791/0 conn(0x7f1df814e8f0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-07-06T13:19:39.117 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- 172.21.15.148:0/1514611532 shutdown_connections 2020-07-06T13:19:39.117 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- 172.21.15.148:0/1514611532 shutdown_connections 2020-07-06T13:19:39.118 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- 172.21.15.148:0/1514611532 wait complete. 2020-07-06T13:19:39.118 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.113 7f1dfd03f700 1 -- 172.21.15.148:0/1514611532 >> 172.21.15.148:0/1514611532 conn(0x7f1df8143fb0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:39.118 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1dfd03f700 1 Processor -- start 2020-07-06T13:19:39.118 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1dfd03f700 1 -- - start start 2020-07-06T13:19:39.118 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1dfd03f700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df815f920 con 0 2020-07-06T13:19:39.119 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1dfd03f700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df8160b90 con 0 2020-07-06T13:19:39.119 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df7027700 1 -- 172.21.15.148:0/4040635575 learned_addr learned my addr 172.21.15.148:0/4040635575 2020-07-06T13:19:39.119 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1dec002c00 con 0x7f1df8091de0 2020-07-06T13:19:39.119 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2025443203 0 0) 0x7f1dec002100 con 0x7f1df8091de0 2020-07-06T13:19:39.119 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1dd8002960 con 0 2020-07-06T13:19:39.120 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1de8003fa0 con 0x7f1df8092560 2020-07-06T13:19:39.120 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2827964048 0 0) 0x7f1de80034c0 con 0x7f1df8092560 2020-07-06T13:19:39.120 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1dd8004620 con 0 2020-07-06T13:19:39.120 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1974470451 0 0) 0x7f1dec001370 con 0x7f1df8091de0 2020-07-06T13:19:39.120 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1dd8002ee0 con 0 2020-07-06T13:19:39.121 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3149733162 0 0) 0x7f1de8003960 con 0x7f1df8092560 2020-07-06T13:19:39.121 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1dd8003540 con 0 2020-07-06T13:19:39.122 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2553536843 0 0) 0x7f1dec001970 con 0x7f1df8091de0 2020-07-06T13:19:39.122 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 >> 172.21.15.118:6790/0 conn(0x7f1df8092560 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-07-06T13:19:39.123 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.117 7f1df4822700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df807abb0 con 0 2020-07-06T13:19:39.123 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df80718b0 con 0 2020-07-06T13:19:39.123 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df8160360 con 0 2020-07-06T13:19:39.123 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1dec000bf0 con 0x7f1df8091de0 2020-07-06T13:19:39.123 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1dec002e80 con 0x7f1df8091de0 2020-07-06T13:19:39.124 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f1dec0037f0 con 0x7f1df8091de0 2020-07-06T13:19:39.124 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.121 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (397465748 0 0) 0x7f1dec0032d0 con 0x7f1df8091de0 2020-07-06T13:19:39.125 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.125 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df807af50 con 0 2020-07-06T13:19:39.131 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.133 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1df807af50 con 0x7f1df8091de0 2020-07-06T13:19:39.220 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.221 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.manila", "caps": ["mds", "allow *", "osd", "allow rw", "mon", "allow *"]} v 0) v1 -- 0x7f1df8073340 con 0 2020-07-06T13:19:39.225 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.225 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.manila", "caps": ["mds", "allow *", "osd", "allow rw", "mon", "allow *"]}]=0 v8) v1 ==== 158+0+64 (1673548153 0 612879306) 0x7f1dec005050 con 0x7f1df8091de0 2020-07-06T13:19:39.282 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.285 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.manila", "caps": ["mds", "allow *", "osd", "allow rw", "mon", "allow *"]} v 0) v1 -- 0x7f1df80930c0 con 0 2020-07-06T13:19:39.283 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.285 7f1df4822700 1 -- 172.21.15.148:0/4040635575 <== mon.2 172.21.15.118:6791/0 11 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.manila", "caps": ["mds", "allow *", "osd", "allow rw", "mon", "allow *"]}]=0 v8) v1 ==== 158+0+64 (1673548153 0 612879306) 0x7f1dec005290 con 0x7f1df8091de0 2020-07-06T13:19:39.285 INFO:tasks.workunit.client.0.smithi148.stderr:[client.manila] 2020-07-06T13:19:39.285 INFO:tasks.workunit.client.0.smithi148.stderr: key = AQDrJANfc4N6DRAAZWSTrEqceyX+HMnfFOQwcw== 2020-07-06T13:19:39.287 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 >> 172.21.15.118:6800/9723 conn(0x7f1dd8006ed0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-07-06T13:19:39.287 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 >> 172.21.15.118:6791/0 conn(0x7f1df8091de0 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-07-06T13:19:39.287 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 shutdown_connections 2020-07-06T13:19:39.287 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 shutdown_connections 2020-07-06T13:19:39.288 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 wait complete. 2020-07-06T13:19:39.288 INFO:tasks.workunit.client.0.smithi148.stderr:2020-07-06 13:19:39.289 7f1dfd03f700 1 -- 172.21.15.148:0/4040635575 >> 172.21.15.148:0/4040635575 conn(0x7f1df8087d00 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:39.306 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo touch -- /etc/ceph/ceph.keyring 2020-07-06T13:19:39.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo ceph-authtool /etc/ceph/ceph.keyring --import-keyring /tmp/tmp.xQGOdBaPQN 2020-07-06T13:19:39.339 INFO:tasks.workunit.client.0.smithi148.stdout:importing contents of /tmp/tmp.xQGOdBaPQN into /etc/ceph/ceph.keyring 2020-07-06T13:19:39.341 INFO:tasks.workunit.client.0.smithi148.stderr:+ rm -f -- /tmp/tmp.xQGOdBaPQN 2020-07-06T13:19:39.342 INFO:tasks.workunit.client.0.smithi148.stderr:+ create 2020-07-06T13:19:39.343 INFO:tasks.workunit.client.0.smithi148.stderr:+ create_data_isolated 2020-07-06T13:19:39.343 INFO:tasks.workunit.client.0.smithi148.stderr:+ local 'PAYLOAD= 2020-07-06T13:19:39.343 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_isolated") 2020-07-06T13:19:39.343 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33), data_isolated=True) 2020-07-06T13:19:39.343 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_data_isolated", tenant_id="test") 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_data_isolated]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:+ run_payload ' 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_isolated") 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33), data_isolated=True) 2020-07-06T13:19:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_data_isolated", tenant_id="test") 2020-07-06T13:19:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_data_isolated]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:+ import_key vol_data_isolated 2020-07-06T13:19:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:+ local 'payload= 2020-07-06T13:19:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_isolated") 2020-07-06T13:19:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33), data_isolated=True) 2020-07-06T13:19:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_data_isolated", tenant_id="test") 2020-07-06T13:19:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_data_isolated]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:+ local client=vol_data_isolated 2020-07-06T13:19:39.347 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo python2 2020-07-06T13:19:39.347 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2020-07-06T13:19:39.347 INFO:tasks.workunit.client.0.smithi148.stderr:+ local keyring=/etc/ceph/ceph.client.vol_data_isolated.keyring 2020-07-06T13:19:39.347 INFO:tasks.workunit.client.0.smithi148.stderr:++ mktemp 2020-07-06T13:19:39.348 INFO:tasks.workunit.client.0.smithi148.stderr:+ local T=/tmp/tmp.4jEZDpKig4 2020-07-06T13:19:39.348 INFO:tasks.workunit.client.0.smithi148.stderr:+ tee /tmp/tmp.4jEZDpKig4 2020-07-06T13:19:39.417 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to RADOS with config /etc/ceph/ceph.conf... 2020-07-06T13:19:39.435 INFO:tasks.workunit.client.0.smithi148.stderr:Connection to RADOS complete 2020-07-06T13:19:39.435 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to cephfs... 2020-07-06T13:19:39.435 INFO:tasks.workunit.client.0.smithi148.stderr:CephFS initializing... 2020-07-06T13:19:39.439 INFO:tasks.workunit.client.0.smithi148.stderr:CephFS mounting... 2020-07-06T13:19:39.446 INFO:tasks.workunit.client.0.smithi148.stderr:Connection to cephfs complete 2020-07-06T13:19:39.446 INFO:tasks.workunit.client.0.smithi148.stderr:Recovering from partial auth updates (if any)... 2020-07-06T13:19:39.446 INFO:tasks.workunit.client.0.smithi148.stderr:Nothing to recover. No auth meta files. 2020-07-06T13:19:39.447 INFO:tasks.workunit.client.0.smithi148.stderr:create_volume: /volumes/_nogroup/vol_isolated 2020-07-06T13:19:39.459 INFO:tasks.workunit.client.0.smithi148.stderr:create_volume: None/vol_isolated, create pool fsvolume_vol_isolated as data_isolated =True. 2020-07-06T13:19:45.359 INFO:tasks.workunit.client.0.smithi148.stderr:create_volume: None/vol_isolated, using rados namespace fsvolumens_vol_isolated to isolate data. 2020-07-06T13:19:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:Creating meta for ID vol_data_isolated with tenant test 2020-07-06T13:19:45.373 INFO:tasks.workunit.client.0.smithi148.stderr:Authorize: no existing meta 2020-07-06T13:19:45.383 INFO:tasks.workunit.client.0.smithi148.stderr:Authorizing Ceph id 'vol_data_isolated' for path '/volumes/_nogroup/vol_isolated' 2020-07-06T13:19:45.817 INFO:tasks.workunit.client.0.smithi148.stderr:disconnect 2020-07-06T13:19:45.817 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting cephfs... 2020-07-06T13:19:45.823 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting cephfs complete 2020-07-06T13:19:45.823 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting rados... 2020-07-06T13:19:45.826 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting rados complete 2020-07-06T13:19:45.829 INFO:tasks.workunit.client.0.smithi148.stderr:disconnect 2020-07-06T13:19:45.831 INFO:tasks.workunit.client.0.smithi148.stderr:[client.vol_data_isolated] 2020-07-06T13:19:45.831 INFO:tasks.workunit.client.0.smithi148.stderr: key = AQDxJANfoO+JFxAA7EQlr9pWGsmlMzPBZsYFFA== 2020-07-06T13:19:45.835 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo touch -- /etc/ceph/ceph.client.vol_data_isolated.keyring 2020-07-06T13:19:45.845 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo ceph-authtool /etc/ceph/ceph.client.vol_data_isolated.keyring --import-keyring /tmp/tmp.4jEZDpKig4 2020-07-06T13:19:45.866 INFO:tasks.workunit.client.0.smithi148.stdout:importing contents of /tmp/tmp.4jEZDpKig4 into /etc/ceph/ceph.client.vol_data_isolated.keyring 2020-07-06T13:19:45.868 INFO:tasks.workunit.client.0.smithi148.stderr:+ rm -f -- /tmp/tmp.4jEZDpKig4 2020-07-06T13:19:45.870 INFO:tasks.workunit.client.0.smithi148.stderr:+ create_default 2020-07-06T13:19:45.870 INFO:tasks.workunit.client.0.smithi148.stderr:+ local 'PAYLOAD= 2020-07-06T13:19:45.870 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_default") 2020-07-06T13:19:45.871 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33)) 2020-07-06T13:19:45.871 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_default", tenant_id="test") 2020-07-06T13:19:45.871 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_default]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:45.871 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:45.871 INFO:tasks.workunit.client.0.smithi148.stderr:+ run_payload ' 2020-07-06T13:19:45.872 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_default") 2020-07-06T13:19:45.872 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33)) 2020-07-06T13:19:45.872 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_default", tenant_id="test") 2020-07-06T13:19:45.872 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_default]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:45.872 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:+ local 'payload= 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:vp = VolumePath(None, "vol_default") 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:vc.create_volume(vp, (1<<33)) 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:auth_result = vc.authorize(vp, "vol_default", tenant_id="test") 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:print("[client.vol_default]\n\tkey = ", auth_result["auth_key"]) 2020-07-06T13:19:45.873 INFO:tasks.workunit.client.0.smithi148.stderr:' 2020-07-06T13:19:45.874 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo python2 2020-07-06T13:19:45.874 INFO:tasks.workunit.client.0.smithi148.stderr:+ import_key vol_default 2020-07-06T13:19:45.874 INFO:tasks.workunit.client.0.smithi148.stderr:+ local client=vol_default 2020-07-06T13:19:45.874 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2020-07-06T13:19:45.875 INFO:tasks.workunit.client.0.smithi148.stderr:+ local keyring=/etc/ceph/ceph.client.vol_default.keyring 2020-07-06T13:19:45.875 INFO:tasks.workunit.client.0.smithi148.stderr:++ mktemp 2020-07-06T13:19:45.875 INFO:tasks.workunit.client.0.smithi148.stderr:+ local T=/tmp/tmp.ZPMk6tjs96 2020-07-06T13:19:45.876 INFO:tasks.workunit.client.0.smithi148.stderr:+ tee /tmp/tmp.ZPMk6tjs96 2020-07-06T13:19:45.916 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to RADOS with config /etc/ceph/ceph.conf... 2020-07-06T13:19:45.930 INFO:tasks.workunit.client.0.smithi148.stderr:Connection to RADOS complete 2020-07-06T13:19:45.931 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to cephfs... 2020-07-06T13:19:45.931 INFO:tasks.workunit.client.0.smithi148.stderr:CephFS initializing... 2020-07-06T13:19:45.935 INFO:tasks.workunit.client.0.smithi148.stderr:CephFS mounting... 2020-07-06T13:19:45.943 INFO:tasks.workunit.client.0.smithi148.stderr:Connection to cephfs complete 2020-07-06T13:19:45.943 INFO:tasks.workunit.client.0.smithi148.stderr:Recovering from partial auth updates (if any)... 2020-07-06T13:19:45.957 INFO:tasks.workunit.client.0.smithi148.stderr:Recovered from partial auth updates (if any). 2020-07-06T13:19:45.958 INFO:tasks.workunit.client.0.smithi148.stderr:create_volume: /volumes/_nogroup/vol_default 2020-07-06T13:19:45.967 INFO:tasks.workunit.client.0.smithi148.stderr:create_volume: None/vol_default, using rados namespace fsvolumens_vol_default to isolate data. 2020-07-06T13:19:45.976 INFO:tasks.workunit.client.0.smithi148.stderr:Creating meta for ID vol_default with tenant test 2020-07-06T13:19:45.976 INFO:tasks.workunit.client.0.smithi148.stderr:Authorize: no existing meta 2020-07-06T13:19:45.989 INFO:tasks.workunit.client.0.smithi148.stderr:Authorizing Ceph id 'vol_default' for path '/volumes/_nogroup/vol_default' 2020-07-06T13:19:46.014 INFO:tasks.workunit.client.0.smithi148.stderr:disconnect 2020-07-06T13:19:46.014 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting cephfs... 2020-07-06T13:19:46.020 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting cephfs complete 2020-07-06T13:19:46.020 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting rados... 2020-07-06T13:19:46.023 INFO:tasks.workunit.client.0.smithi148.stderr:Disconnecting rados complete 2020-07-06T13:19:46.026 INFO:tasks.workunit.client.0.smithi148.stderr:disconnect 2020-07-06T13:19:46.028 INFO:tasks.workunit.client.0.smithi148.stderr:[client.vol_default] 2020-07-06T13:19:46.028 INFO:tasks.workunit.client.0.smithi148.stderr: key = AQDxJANf8N54OxAAPfiK1BVGoM+w7Xo54EAz7g== 2020-07-06T13:19:46.032 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo touch -- /etc/ceph/ceph.client.vol_default.keyring 2020-07-06T13:19:46.041 INFO:tasks.workunit.client.0.smithi148.stderr:+ sudo ceph-authtool /etc/ceph/ceph.client.vol_default.keyring --import-keyring /tmp/tmp.ZPMk6tjs96 2020-07-06T13:19:46.064 INFO:tasks.workunit.client.0.smithi148.stdout:importing contents of /tmp/tmp.ZPMk6tjs96 into /etc/ceph/ceph.client.vol_default.keyring 2020-07-06T13:19:46.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ rm -f -- /tmp/tmp.ZPMk6tjs96 2020-07-06T13:19:46.069 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-07-06T13:19:46.069 INFO:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-07-06T13:19:46.124 INFO:tasks.workunit:Stopping ['fs/upgrade/volume_client'] on client.0... 2020-07-06T13:19:46.124 INFO:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-07-06T13:19:46.365 DEBUG:teuthology.parallel:result is None 2020-07-06T13:19:46.366 INFO:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-07-06T13:19:46.380 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-07-06T13:19:46.380 INFO:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:46.452 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2020-07-06T13:19:46.452 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:19:46.461 INFO:teuthology.task.print:**** fs/volume_client create 2020-07-06T13:19:46.461 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-07-06T13:19:46.508 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-07-06T13:19:46.509 INFO:tasks.ceph_fuse:config is {'client.0': {'auth_id': 'vol_data_isolated', 'mount_path': '/volumes/_nogroup/vol_isolated', 'mountpoint': 'mnt.0'}, 'client.1': {'auth_id': 'vol_default', 'mount_path': '/volumes/_nogroup/vol_default', 'mountpoint': 'mnt.1'}} 2020-07-06T13:19:46.509 INFO:tasks.ceph_fuse:new config is {'client.0': {'auth_id': 'vol_data_isolated', 'mount_path': '/volumes/_nogroup/vol_isolated', 'mountpoint': 'mnt.0'}, 'client.1': {'auth_id': 'vol_default', 'mount_path': '/volumes/_nogroup/vol_default', 'mountpoint': 'mnt.1'}} 2020-07-06T13:19:46.510 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-07-06T13:19:46.510 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:19:46.666 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.695 7f5c2a439700 1 Processor -- start 2020-07-06T13:19:46.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.695 7f5c2a439700 1 -- - start start 2020-07-06T13:19:46.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c2a439700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2414ba80 con 0 2020-07-06T13:19:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c2a439700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2414be20 con 0 2020-07-06T13:19:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c23fff700 1 -- 172.21.15.118:0/178378053 learned_addr learned my addr 172.21.15.118:0/178378053 2020-07-06T13:19:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c1c0025a0 con 0x7f5c2414b340 2020-07-06T13:19:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c18003630 con 0x7f5c24148040 2020-07-06T13:19:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3659135617 0 0) 0x7f5c1c002920 con 0x7f5c2414b340 2020-07-06T13:19:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5c10002f00 con 0 2020-07-06T13:19:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3437298108 0 0) 0x7f5c18003930 con 0x7f5c24148040 2020-07-06T13:19:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5c100047c0 con 0 2020-07-06T13:19:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1530858953 0 0) 0x7f5c1c002d40 con 0x7f5c2414b340 2020-07-06T13:19:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 >> 172.21.15.118:6790/0 conn(0x7f5c24148040 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-07-06T13:19:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2407a7e0 con 0 2020-07-06T13:19:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5c24116df0 con 0x7f5c2414b340 2020-07-06T13:19:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c22ffd700 1 -- 172.21.15.118:0/178378053 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c1c0011d0 con 0x7f5c2414b340 2020-07-06T13:19:46.702 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.699 7f5c2a439700 1 -- 172.21.15.118:0/178378053 >> 172.21.15.118:6789/0 conn(0x7f5c2414b340 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-07-06T13:19:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.703 7f5c2a439700 1 -- 172.21.15.118:0/178378053 shutdown_connections 2020-07-06T13:19:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.703 7f5c2a439700 1 -- 172.21.15.118:0/178378053 shutdown_connections 2020-07-06T13:19:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.703 7f5c2a439700 1 -- 172.21.15.118:0/178378053 wait complete. 2020-07-06T13:19:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.703 7f5c2a439700 1 -- 172.21.15.118:0/178378053 >> 172.21.15.118:0/178378053 conn(0x7f5c24143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c2a439700 1 Processor -- start 2020-07-06T13:19:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c2a439700 1 -- - start start 2020-07-06T13:19:46.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c2a439700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240a3b60 con 0 2020-07-06T13:19:46.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c2a439700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240a6930 con 0 2020-07-06T13:19:46.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c23fff700 1 -- 172.21.15.118:0/3647236988 learned_addr learned my addr 172.21.15.118:0/3647236988 2020-07-06T13:19:46.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c18003f60 con 0x7f5c240a31a0 2020-07-06T13:19:46.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2109243240 0 0) 0x7f5c18003490 con 0x7f5c240a31a0 2020-07-06T13:19:46.708 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5c040029c0 con 0 2020-07-06T13:19:46.708 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c1c002d40 con 0x7f5c240a6180 2020-07-06T13:19:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3733791536 0 0) 0x7f5c1c002350 con 0x7f5c240a6180 2020-07-06T13:19:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5c04004680 con 0 2020-07-06T13:19:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3524728753 0 0) 0x7f5c18000e50 con 0x7f5c240a31a0 2020-07-06T13:19:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.707 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5c04002f40 con 0 2020-07-06T13:19:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1114286514 0 0) 0x7f5c18001420 con 0x7f5c240a31a0 2020-07-06T13:19:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 >> 172.21.15.118:6790/0 conn(0x7f5c240a6180 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-07-06T13:19:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2407aa40 con 0 2020-07-06T13:19:46.713 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c240b2640 con 0 2020-07-06T13:19:46.713 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2418b0e0 con 0 2020-07-06T13:19:46.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5c240e9f60 con 0x7f5c240a31a0 2020-07-06T13:19:46.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.711 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5c18001850 con 0x7f5c240a31a0 2020-07-06T13:19:46.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.715 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f5c18001b50 con 0x7f5c240a31a0 2020-07-06T13:19:46.715 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.715 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(25..25 src has 1..25) v4 ==== 3119+0+0 (1739054351 0 0) 0x7f5c18006390 con 0x7f5c240a31a0 2020-07-06T13:19:46.716 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.719 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c00002050 con 0 2020-07-06T13:19:46.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.723 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f5c180050c0 con 0x7f5c240a31a0 2020-07-06T13:19:46.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.931 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c00001200 con 0 2020-07-06T13:19:46.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.935 7f5c217fa700 1 -- 172.21.15.118:0/3647236988 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+7457 (780366164 0 2286100430) 0x7f5c180049b0 con 0x7f5c240a31a0 2020-07-06T13:19:46.933 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:46.933 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:19:46.401554","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"fsvolume_vol_isolated","create_time":"2020-07-06 13:19:39.526679","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":3997,"pg_placement_num":3997,"last_change":"19","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:19:46.960 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 >> 172.21.15.118:6800/9723 conn(0x7f5c040065f0 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-07-06T13:19:46.960 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 >> 172.21.15.118:6791/0 conn(0x7f5c240a31a0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-07-06T13:19:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 shutdown_connections 2020-07-06T13:19:46.963 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 shutdown_connections 2020-07-06T13:19:46.963 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 wait complete. 2020-07-06T13:19:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:46.963 7f5c2a439700 1 -- 172.21.15.118:0/3647236988 >> 172.21.15.118:0/3647236988 conn(0x7f5c240992e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:46.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-06 13:18:56.457152', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2020-07-06 13:18:56.782594', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'fsvolume_vol_isolated', 'create_time': '2020-07-06 13:19:39.526679', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 3997, 'pg_placement_num': 3997, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-06T13:19:46.981 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:19:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.167 7f5e1cf4a700 1 Processor -- start 2020-07-06T13:19:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.167 7f5e1cf4a700 1 -- - start start 2020-07-06T13:19:47.166 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.167 7f5e1cf4a700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1814bad0 con 0 2020-07-06T13:19:47.166 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.167 7f5e1cf4a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1814be70 con 0 2020-07-06T13:19:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.167 7f5e16570700 1 -- 172.21.15.118:0/1216253049 learned_addr learned my addr 172.21.15.118:0/1216253049 2020-07-06T13:19:47.175 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e080022a0 con 0x7f5e18148040 2020-07-06T13:19:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e100039b0 con 0x7f5e1814b340 2020-07-06T13:19:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1569455174 0 0) 0x7f5e08002620 con 0x7f5e18148040 2020-07-06T13:19:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dfc002f00 con 0 2020-07-06T13:19:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1570623970 0 0) 0x7f5e10003cb0 con 0x7f5e1814b340 2020-07-06T13:19:47.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dfc0047b0 con 0 2020-07-06T13:19:47.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2309300346 0 0) 0x7f5e08002ac0 con 0x7f5e18148040 2020-07-06T13:19:47.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 >> 172.21.15.118:6789/0 conn(0x7f5e1814b340 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-07-06T13:19:47.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1807a910 con 0 2020-07-06T13:19:47.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5e08000bf0 con 0x7f5e18148040 2020-07-06T13:19:47.178 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e15d6f700 1 -- 172.21.15.118:0/1216253049 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e08001010 con 0x7f5e18148040 2020-07-06T13:19:47.178 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.175 7f5e1cf4a700 1 -- 172.21.15.118:0/1216253049 >> 172.21.15.118:6791/0 conn(0x7f5e18148040 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-07-06T13:19:47.179 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.179 7f5e1cf4a700 1 -- 172.21.15.118:0/1216253049 shutdown_connections 2020-07-06T13:19:47.179 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.179 7f5e1cf4a700 1 -- 172.21.15.118:0/1216253049 shutdown_connections 2020-07-06T13:19:47.181 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.179 7f5e1cf4a700 1 -- 172.21.15.118:0/1216253049 wait complete. 2020-07-06T13:19:47.182 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.179 7f5e1cf4a700 1 -- 172.21.15.118:0/1216253049 >> 172.21.15.118:0/1216253049 conn(0x7f5e18143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.182 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 Processor -- start 2020-07-06T13:19:47.182 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 -- - start start 2020-07-06T13:19:47.182 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1809fd70 con 0 2020-07-06T13:19:47.183 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e180a2a50 con 0 2020-07-06T13:19:47.183 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e16d71700 1 -- 172.21.15.118:0/916341161 learned_addr learned my addr 172.21.15.118:0/916341161 2020-07-06T13:19:47.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e08000e50 con 0x7f5e1809f2e0 2020-07-06T13:19:47.184 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1779478344 0 0) 0x7f5e08001ff0 con 0x7f5e1809f2e0 2020-07-06T13:19:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5df40029c0 con 0 2020-07-06T13:19:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e10004250 con 0x7f5e180a22f0 2020-07-06T13:19:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3530366734 0 0) 0x7f5e10003810 con 0x7f5e180a22f0 2020-07-06T13:19:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5df4004680 con 0 2020-07-06T13:19:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2049886639 0 0) 0x7f5e08002370 con 0x7f5e1809f2e0 2020-07-06T13:19:47.186 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5df4004fa0 con 0 2020-07-06T13:19:47.186 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3318637572 0 0) 0x7f5e080017c0 con 0x7f5e1809f2e0 2020-07-06T13:19:47.186 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 >> 172.21.15.118:6791/0 conn(0x7f5e180a22f0 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-07-06T13:19:47.186 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e07fff700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1807ab70 con 0 2020-07-06T13:19:47.186 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e180712c0 con 0 2020-07-06T13:19:47.187 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.183 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1818b480 con 0 2020-07-06T13:19:47.187 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.187 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5e180e9f60 con 0x7f5e1809f2e0 2020-07-06T13:19:47.187 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.187 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f5e08001a30 con 0x7f5e1809f2e0 2020-07-06T13:19:47.187 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.187 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f5e080033f0 con 0x7f5e1809f2e0 2020-07-06T13:19:47.188 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.187 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(25..25 src has 1..25) v4 ==== 3119+0+0 (1739054351 0 0) 0x7f5e08001c70 con 0x7f5e1809f2e0 2020-07-06T13:19:47.217 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.219 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8002050 con 0 2020-07-06T13:19:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.227 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f5e08003c00 con 0x7f5e1809f2e0 2020-07-06T13:19:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.347 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f5df8001280 con 0 2020-07-06T13:19:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e07fff700 1 -- 172.21.15.118:0/916341161 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (1826213166 0 265718887) 0x7f5e08002fc0 con 0x7f5e1809f2e0 2020-07-06T13:19:47.349 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:47.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 >> 172.21.15.118:6800/9723 conn(0x7f5df4005800 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-07-06T13:19:47.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 >> 172.21.15.118:6790/0 conn(0x7f5e1809f2e0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-07-06T13:19:47.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 shutdown_connections 2020-07-06T13:19:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 shutdown_connections 2020-07-06T13:19:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 wait complete. 2020-07-06T13:19:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.351 7f5e1cf4a700 1 -- 172.21.15.118:0/916341161 >> 172.21.15.118:0/916341161 conn(0x7f5e18178000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.359 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-06T13:19:47.430 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:47.456 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cb20ec700 1 Processor -- start 2020-07-06T13:19:47.457 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cb20ec700 1 -- - start start 2020-07-06T13:19:47.458 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cb20ec700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac14ba70 con 0 2020-07-06T13:19:47.458 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cb20ec700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac14be10 con 0 2020-07-06T13:19:47.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cabfff700 1 -- 172.21.15.118:0/3289442219 learned_addr learned my addr 172.21.15.118:0/3289442219 2020-07-06T13:19:47.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9c9c003630 con 0x7f9cac148030 2020-07-06T13:19:47.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (711341032 0 0) 0x7f9c9c0039b0 con 0x7f9cac148030 2020-07-06T13:19:47.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9c980029d0 con 0 2020-07-06T13:19:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9ca0002220 con 0x7f9cac14b330 2020-07-06T13:19:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1252511963 0 0) 0x7f9ca00025a0 con 0x7f9cac14b330 2020-07-06T13:19:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9c980047c0 con 0 2020-07-06T13:19:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1912277206 0 0) 0x7f9c9c003eb0 con 0x7f9cac148030 2020-07-06T13:19:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 >> 172.21.15.118:6791/0 conn(0x7f9cac14b330 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-07-06T13:19:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac07a900 con 0 2020-07-06T13:19:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9cac0e9f50 con 0x7f9cac148030 2020-07-06T13:19:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9caaffd700 1 -- 172.21.15.118:0/3289442219 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9c9c001010 con 0x7f9cac148030 2020-07-06T13:19:47.463 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.459 7f9cb20ec700 1 -- 172.21.15.118:0/3289442219 >> 172.21.15.118:6789/0 conn(0x7f9cac148030 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-07-06T13:19:47.463 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.463 7f9cb20ec700 1 -- 172.21.15.118:0/3289442219 shutdown_connections 2020-07-06T13:19:47.464 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.463 7f9cb20ec700 1 -- 172.21.15.118:0/3289442219 shutdown_connections 2020-07-06T13:19:47.464 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.463 7f9cb20ec700 1 -- 172.21.15.118:0/3289442219 wait complete. 2020-07-06T13:19:47.464 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.463 7f9cb20ec700 1 -- 172.21.15.118:0/3289442219 >> 172.21.15.118:0/3289442219 conn(0x7f9cac143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.465 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 Processor -- start 2020-07-06T13:19:47.465 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 -- - start start 2020-07-06T13:19:47.466 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac092f10 con 0 2020-07-06T13:19:47.466 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0a4080 con 0 2020-07-06T13:19:47.466 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cab7fe700 1 -- 172.21.15.118:0/3665794885 learned_addr learned my addr 172.21.15.118:0/3665794885 2020-07-06T13:19:47.467 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9ca00024f0 con 0x7f9cac0a6690 2020-07-06T13:19:47.468 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (195503609 0 0) 0x7f9ca0002870 con 0x7f9cac0a6690 2020-07-06T13:19:47.468 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9c980050f0 con 0 2020-07-06T13:19:47.468 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9c9c000e50 con 0x7f9cac0a3740 2020-07-06T13:19:47.468 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3792290409 0 0) 0x7f9c9c001520 con 0x7f9cac0a3740 2020-07-06T13:19:47.468 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9c98006d70 con 0 2020-07-06T13:19:47.469 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2366297770 0 0) 0x7f9ca0000e50 con 0x7f9cac0a6690 2020-07-06T13:19:47.469 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c98005670 con 0 2020-07-06T13:19:47.469 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1521345417 0 0) 0x7f9c9c0018a0 con 0x7f9cac0a3740 2020-07-06T13:19:47.469 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c98005d00 con 0 2020-07-06T13:19:47.470 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2418594967 0 0) 0x7f9c9c003380 con 0x7f9cac0a3740 2020-07-06T13:19:47.470 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 >> 172.21.15.118:6791/0 conn(0x7f9cac0a6690 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-07-06T13:19:47.470 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac07ab60 con 0 2020-07-06T13:19:47.470 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac071390 con 0 2020-07-06T13:19:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.467 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac18b6c0 con 0 2020-07-06T13:19:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.471 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9c9c000bf0 con 0x7f9cac0a3740 2020-07-06T13:19:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.471 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9c9c0037b0 con 0x7f9cac0a3740 2020-07-06T13:19:47.472 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.471 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f9c9c0045c0 con 0x7f9cac0a3740 2020-07-06T13:19:47.472 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.471 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f9c9c005ee0 con 0x7f9cac0a3740 2020-07-06T13:19:47.472 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.471 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c002320 con 0 2020-07-06T13:19:47.474 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.475 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f9c9c0040a0 con 0x7f9cac0a3740 2020-07-06T13:19:47.608 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f9c880020f0 con 0 2020-07-06T13:19:47.609 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9ca97fa700 1 -- 172.21.15.118:0/3665794885 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v26) v1 ==== 104+0+10 (2391828516 0 265718887) 0x7f9c9c004380 con 0x7f9cac0a3740 2020-07-06T13:19:47.609 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:47.610 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 >> 172.21.15.118:6800/9723 conn(0x7f9c980092a0 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-07-06T13:19:47.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 >> 172.21.15.118:6790/0 conn(0x7f9cac0a3740 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-07-06T13:19:47.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 shutdown_connections 2020-07-06T13:19:47.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 shutdown_connections 2020-07-06T13:19:47.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 wait complete. 2020-07-06T13:19:47.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.611 7f9cb20ec700 1 -- 172.21.15.118:0/3665794885 >> 172.21.15.118:0/3665794885 conn(0x7f9cac0997d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.620 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-06T13:19:47.704 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 Processor -- start 2020-07-06T13:19:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- - start start 2020-07-06T13:19:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20414ba70 con 0 2020-07-06T13:19:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20414be10 con 0 2020-07-06T13:19:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2037fe700 1 -- 172.21.15.118:0/1058324009 learned_addr learned my addr 172.21.15.118:0/1058324009 2020-07-06T13:19:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1f4002220 con 0x7ff20414b330 2020-07-06T13:19:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1813077237 0 0) 0x7ff1f40025a0 con 0x7ff20414b330 2020-07-06T13:19:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1f0002a20 con 0 2020-07-06T13:19:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1fc0039b0 con 0x7ff204148030 2020-07-06T13:19:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1065290472 0 0) 0x7ff1fc003cb0 con 0x7ff204148030 2020-07-06T13:19:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1f00046c0 con 0 2020-07-06T13:19:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1144673551 0 0) 0x7ff1f4002b20 con 0x7ff20414b330 2020-07-06T13:19:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 >> 172.21.15.118:6791/0 conn(0x7ff204148030 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-07-06T13:19:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20407a900 con 0 2020-07-06T13:19:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff204116de0 con 0x7ff20414b330 2020-07-06T13:19:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2027fc700 1 -- 172.21.15.118:0/1058324009 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1f4001010 con 0x7ff20414b330 2020-07-06T13:19:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- 172.21.15.118:0/1058324009 >> 172.21.15.118:6790/0 conn(0x7ff20414b330 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-07-06T13:19:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- 172.21.15.118:0/1058324009 shutdown_connections 2020-07-06T13:19:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- 172.21.15.118:0/1058324009 shutdown_connections 2020-07-06T13:19:47.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- 172.21.15.118:0/1058324009 wait complete. 2020-07-06T13:19:47.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.715 7ff2098eb700 1 -- 172.21.15.118:0/1058324009 >> 172.21.15.118:0/1058324009 conn(0x7ff204143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 Processor -- start 2020-07-06T13:19:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 -- - start start 2020-07-06T13:19:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040a3cf0 con 0 2020-07-06T13:19:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040a6ac0 con 0 2020-07-06T13:19:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2037fe700 1 -- 172.21.15.118:0/503003692 learned_addr learned my addr 172.21.15.118:0/503003692 2020-07-06T13:19:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1fc0042e0 con 0x7ff2040a3300 2020-07-06T13:19:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1f4000e50 con 0x7ff2040a6310 2020-07-06T13:19:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (985045929 0 0) 0x7ff1fc0037f0 con 0x7ff2040a3300 2020-07-06T13:19:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1e4002df0 con 0 2020-07-06T13:19:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (896146064 0 0) 0x7ff1f4001f70 con 0x7ff2040a6310 2020-07-06T13:19:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1e4004620 con 0 2020-07-06T13:19:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (145537657 0 0) 0x7ff1fc003cf0 con 0x7ff2040a3300 2020-07-06T13:19:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e4004df0 con 0 2020-07-06T13:19:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2353265989 0 0) 0x7ff1f40021e0 con 0x7ff2040a6310 2020-07-06T13:19:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e4006570 con 0 2020-07-06T13:19:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1126154184 0 0) 0x7ff1fc001470 con 0x7ff2040a3300 2020-07-06T13:19:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 >> 172.21.15.118:6791/0 conn(0x7ff2040a6310 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20407ab60 con 0 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040712b0 con 0 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff2098eb700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20418b100 con 0 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff2040e9f50 con 0x7ff2040a3300 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff1fc0018a0 con 0x7ff2040a3300 2020-07-06T13:19:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7ff1fc0045e0 con 0x7ff2040a3300 2020-07-06T13:19:47.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.719 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7ff1fc001ae0 con 0x7ff2040a3300 2020-07-06T13:19:47.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.731 7ff2098eb700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20407af00 con 0 2020-07-06T13:19:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.731 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff20407af00 con 0x7ff2040a3300 2020-07-06T13:19:47.817 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ff204156330 con 0 2020-07-06T13:19:47.818 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff200ff9700 1 -- 172.21.15.118:0/503003692 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v26) v1 ==== 100+0+10 (2688139813 0 265718887) 0x7ff1fc0057e0 con 0x7ff2040a3300 2020-07-06T13:19:47.819 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 >> 172.21.15.118:6800/9723 conn(0x7ff1e40072a0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-07-06T13:19:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 >> 172.21.15.118:6789/0 conn(0x7ff2040a3300 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-07-06T13:19:47.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 shutdown_connections 2020-07-06T13:19:47.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 shutdown_connections 2020-07-06T13:19:47.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 wait complete. 2020-07-06T13:19:47.822 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.819 7ff2098eb700 1 -- 172.21.15.118:0/503003692 >> 172.21.15.118:0/503003692 conn(0x7ff204099630 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.829 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get fsvolume_vol_isolated pg_num 2020-07-06T13:19:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:47.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.919 7f963b005700 1 Processor -- start 2020-07-06T13:19:47.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.919 7f963b005700 1 -- - start start 2020-07-06T13:19:47.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.919 7f963b005700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963414bac0 con 0 2020-07-06T13:19:47.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.919 7f963b005700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963414be60 con 0 2020-07-06T13:19:47.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.919 7f963882a700 1 -- 172.21.15.118:0/2618236690 learned_addr learned my addr 172.21.15.118:0/2618236690 2020-07-06T13:19:47.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f962c002620 con 0x7f9634148030 2020-07-06T13:19:47.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2427504506 0 0) 0x7f962c0029a0 con 0x7f9634148030 2020-07-06T13:19:47.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9620002a20 con 0 2020-07-06T13:19:47.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9628003630 con 0x7f963414b330 2020-07-06T13:19:47.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2069198192 0 0) 0x7f9628003930 con 0x7f963414b330 2020-07-06T13:19:47.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f96200046b0 con 0 2020-07-06T13:19:47.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1149278510 0 0) 0x7f962c002f70 con 0x7f9634148030 2020-07-06T13:19:47.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 >> 172.21.15.118:6789/0 conn(0x7f963414b330 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-07-06T13:19:47.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963407a900 con 0 2020-07-06T13:19:47.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f962c000f70 con 0x7f9634148030 2020-07-06T13:19:47.924 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- 172.21.15.118:0/2618236690 >> 172.21.15.118:6791/0 conn(0x7f9634148030 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-07-06T13:19:47.924 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f9633fff700 1 -- 172.21.15.118:0/2618236690 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f962c0013d0 con 0x7f9634148030 2020-07-06T13:19:47.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- 172.21.15.118:0/2618236690 shutdown_connections 2020-07-06T13:19:47.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- 172.21.15.118:0/2618236690 shutdown_connections 2020-07-06T13:19:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- 172.21.15.118:0/2618236690 wait complete. 2020-07-06T13:19:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- 172.21.15.118:0/2618236690 >> 172.21.15.118:0/2618236690 conn(0x7f9634143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 Processor -- start 2020-07-06T13:19:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- - start start 2020-07-06T13:19:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963409fca0 con 0 2020-07-06T13:19:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963b005700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340a2a20 con 0 2020-07-06T13:19:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.923 7f963902b700 1 -- 172.21.15.118:0/3619508007 learned_addr learned my addr 172.21.15.118:0/3619508007 2020-07-06T13:19:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9628003e70 con 0x7f96340a2270 2020-07-06T13:19:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2483416346 0 0) 0x7f9628003470 con 0x7f96340a2270 2020-07-06T13:19:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9614002960 con 0 2020-07-06T13:19:47.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f962c0011d0 con 0x7f963409f260 2020-07-06T13:19:47.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3144034790 0 0) 0x7f962c002370 con 0x7f963409f260 2020-07-06T13:19:47.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9614004620 con 0 2020-07-06T13:19:47.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3272596512 0 0) 0x7f962c002700 con 0x7f963409f260 2020-07-06T13:19:47.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9614002ee0 con 0 2020-07-06T13:19:47.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1559770934 0 0) 0x7f9628003990 con 0x7f96340a2270 2020-07-06T13:19:47.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9614003540 con 0 2020-07-06T13:19:47.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1457255275 0 0) 0x7f962c001b90 con 0x7f963409f260 2020-07-06T13:19:47.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 >> 172.21.15.118:6790/0 conn(0x7f96340a2270 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-07-06T13:19:47.930 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963407ab60 con 0 2020-07-06T13:19:47.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f963b005700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96340712b0 con 0 2020-07-06T13:19:47.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f963b005700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f963418b500 con 0 2020-07-06T13:19:47.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f962c0016e0 con 0x7f963409f260 2020-07-06T13:19:47.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f962c001e00 con 0x7f963409f260 2020-07-06T13:19:47.931 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f962c0036b0 con 0x7f963409f260 2020-07-06T13:19:47.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.927 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f962c006430 con 0x7f963409f260 2020-07-06T13:19:47.934 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.935 7f963b005700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963407af00 con 0 2020-07-06T13:19:47.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:47.939 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f963407af00 con 0x7f963409f260 2020-07-06T13:19:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.023 7f963b005700 1 -- 172.21.15.118:0/3619508007 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"} v 0) v1 -- 0x7f9634156330 con 0 2020-07-06T13:19:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.023 7f96327fc700 1 -- 172.21.15.118:0/3619508007 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"}]=0 v26) v1 ==== 110+0+13 (28688288 0 66981700) 0x7f962c003e60 con 0x7f963409f260 2020-07-06T13:19:48.024 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 3997 2020-07-06T13:19:48.025 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 >> 172.21.15.118:6800/9723 conn(0x7f9614006ed0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-07-06T13:19:48.025 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 >> 172.21.15.118:6791/0 conn(0x7f963409f260 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-07-06T13:19:48.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 shutdown_connections 2020-07-06T13:19:48.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 shutdown_connections 2020-07-06T13:19:48.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 wait complete. 2020-07-06T13:19:48.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.027 7f963b005700 1 -- 172.21.15.118:0/3619508007 >> 172.21.15.118:0/3619508007 conn(0x7f9634177f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:48.034 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-07-06T13:19:48.035 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:19:48.118 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:48.123 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.123 7ff31aff1700 1 Processor -- start 2020-07-06T13:19:48.123 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.123 7ff31aff1700 1 -- - start start 2020-07-06T13:19:48.124 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.123 7ff31aff1700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31414bae0 con 0 2020-07-06T13:19:48.124 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.123 7ff31aff1700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31414be80 con 0 2020-07-06T13:19:48.124 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff319017700 1 -- 172.21.15.118:0/199062490 learned_addr learned my addr 172.21.15.118:0/199062490 2020-07-06T13:19:48.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff310003630 con 0x7ff314148050 2020-07-06T13:19:48.126 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (844735295 0 0) 0x7ff3100039b0 con 0x7ff314148050 2020-07-06T13:19:48.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff2f8002a20 con 0 2020-07-06T13:19:48.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff3040022a0 con 0x7ff31414b350 2020-07-06T13:19:48.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2479741724 0 0) 0x7ff3040025a0 con 0x7ff31414b350 2020-07-06T13:19:48.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff2f80046b0 con 0 2020-07-06T13:19:48.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2706927570 0 0) 0x7ff310003f80 con 0x7ff314148050 2020-07-06T13:19:48.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 >> 172.21.15.118:6790/0 conn(0x7ff31414b350 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-07-06T13:19:48.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31407a7f0 con 0 2020-07-06T13:19:48.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff3140e9f70 con 0x7ff314148050 2020-07-06T13:19:48.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- 172.21.15.118:0/199062490 >> 172.21.15.118:6789/0 conn(0x7ff314148050 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-07-06T13:19:48.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff30bfff700 1 -- 172.21.15.118:0/199062490 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff310001050 con 0x7ff314148050 2020-07-06T13:19:48.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- 172.21.15.118:0/199062490 shutdown_connections 2020-07-06T13:19:48.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- 172.21.15.118:0/199062490 shutdown_connections 2020-07-06T13:19:48.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- 172.21.15.118:0/199062490 wait complete. 2020-07-06T13:19:48.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- 172.21.15.118:0/199062490 >> 172.21.15.118:0/199062490 conn(0x7ff314143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:48.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 Processor -- start 2020-07-06T13:19:48.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.127 7ff31aff1700 1 -- - start start 2020-07-06T13:19:48.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff31aff1700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140a3cc0 con 0 2020-07-06T13:19:48.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff31aff1700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff314095b40 con 0 2020-07-06T13:19:48.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff319017700 1 -- 172.21.15.118:0/3348605071 learned_addr learned my addr 172.21.15.118:0/3348605071 2020-07-06T13:19:48.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff310000e50 con 0x7ff3140a3280 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff304002ae0 con 0x7ff3140a5030 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3752085941 0 0) 0x7ff310001570 con 0x7ff3140a3280 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff2fc002df0 con 0 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3726164095 0 0) 0x7ff3040020b0 con 0x7ff3140a5030 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff2fc004620 con 0 2020-07-06T13:19:48.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2136980063 0 0) 0x7ff3100017e0 con 0x7ff3140a3280 2020-07-06T13:19:48.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2fc004df0 con 0 2020-07-06T13:19:48.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2659474040 0 0) 0x7ff304002510 con 0x7ff3140a5030 2020-07-06T13:19:48.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2fc006570 con 0 2020-07-06T13:19:48.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4170740257 0 0) 0x7ff310003620 con 0x7ff3140a3280 2020-07-06T13:19:48.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 >> 172.21.15.118:6789/0 conn(0x7ff3140a5030 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-07-06T13:19:48.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31407aa50 con 0 2020-07-06T13:19:48.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140b2690 con 0 2020-07-06T13:19:48.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3140a68e0 con 0 2020-07-06T13:19:48.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff310000bf0 con 0x7ff3140a3280 2020-07-06T13:19:48.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff310003890 con 0x7ff3140a3280 2020-07-06T13:19:48.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7ff310004750 con 0x7ff3140a3280 2020-07-06T13:19:48.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.131 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7ff310006020 con 0x7ff3140a3280 2020-07-06T13:19:48.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.139 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31407add0 con 0 2020-07-06T13:19:48.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.143 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff31407add0 con 0x7ff3140a3280 2020-07-06T13:19:48.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff314070b50 con 0 2020-07-06T13:19:48.228 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff30a7fc700 1 -- 172.21.15.118:0/3348605071 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2251 (4058427516 0 3147250658) 0x7ff310004230 con 0x7ff3140a3280 2020-07-06T13:19:48.229 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2020-07-06T13:19:48.229 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:48.230 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:19:40.336529","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:19:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 >> 172.21.15.118:6800/9723 conn(0x7ff2fc0072a0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-07-06T13:19:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 >> 172.21.15.118:6791/0 conn(0x7ff3140a3280 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-07-06T13:19:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 shutdown_connections 2020-07-06T13:19:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 shutdown_connections 2020-07-06T13:19:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 wait complete. 2020-07-06T13:19:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:48.231 7ff31aff1700 1 -- 172.21.15.118:0/3348605071 >> 172.21.15.118:0/3348605071 conn(0x7ff3140993f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:48.545 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-06 13:18:57.751069', 'modified': '2020-07-06 13:19:40.336529', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4211': {'gid': 4211, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.118:6819/1597074397', 'standby_for_rank': -1, 'standby_for_fscid': -1, 'standby_for_name': '', 'standby_replay': False, 'export_targets': [], 'features': 4611087854031667195}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-06T13:19:48.545 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-06T13:19:48.546 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-07-06T13:19:48.641 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","whoami":0,"id":4211,"want_state":"up:active","state":"up:active","rank_uptime":48.875167,"mdsmap_epoch":7,"osdmap_epoch":26,"osdmap_epoch_barrier":18,"uptime":49.295288} 2020-07-06T13:19:48.647 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "74e2240b-47f9-4a3f-ade9-f9f65278ae84", "id": 4211, "mdsmap_epoch": 7, "osdmap_epoch": 26, "osdmap_epoch_barrier": 18, "rank_uptime": 48.875167, "state": "up:active", "uptime": 49.295288, "want_state": "up:active", "whoami": 0 } 2020-07-06T13:19:48.647 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-07-06T13:19:48.648 INFO:tasks.cephfs.fuse_mount:Client client.vol_data_isolated config is {'auth_id': 'vol_data_isolated', 'mount_path': '/volumes/_nogroup/vol_isolated', 'mountpoint': 'mnt.0'} 2020-07-06T13:19:48.648 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.vol_data_isolated at ubuntu@smithi148.front.sepia.ceph.com mnt.0... 2020-07-06T13:19:48.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:48.649 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec mkdir -p mnt.0) 2020-07-06T13:19:48.654 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:48.711 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:48.712 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:48.771 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:48.772 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:48.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:48.773 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:48.819 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-07-06T13:19:48.819 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --client_mountpoint=/volumes/_nogroup/vol_isolated --name client.vol_data_isolated mnt.0) 2020-07-06T13:19:48.863 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:48.877 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:48.878 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:48.935 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:48.936 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:48.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:48.936 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:49.041 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_data_isolated.smithi148.stderr:ceph-fuse[9176]: starting ceph client 2020-07-06T13:19:49.041 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_data_isolated.smithi148.stderr:2020-07-06 13:19:49.041 7f55797dfb80 -1 init, newargv = 0x55b6aa664940 newargc=7 2020-07-06T13:19:49.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_data_isolated.smithi148.stderr:ceph-fuse[9176]: starting fuse 2020-07-06T13:19:50.084 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:50.100 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:50.100 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:50.155 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:50.156 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:50.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:50.157 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:50.203 INFO:teuthology.orchestra.run.smithi148.stdout:49 2020-07-06T13:19:50.203 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-07-06T13:19:50.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:50.204 INFO:teuthology.orchestra.run.smithi148:> sudo python3 -c ' 2020-07-06T13:19:50.204 INFO:teuthology.orchestra.run.smithi148:> import glob 2020-07-06T13:19:50.205 INFO:teuthology.orchestra.run.smithi148:> import re 2020-07-06T13:19:50.205 INFO:teuthology.orchestra.run.smithi148:> import os 2020-07-06T13:19:50.206 INFO:teuthology.orchestra.run.smithi148:> import subprocess 2020-07-06T13:19:50.206 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:50.206 INFO:teuthology.orchestra.run.smithi148:> def find_socket(client_name): 2020-07-06T13:19:50.206 INFO:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.vol_data_isolated.*.asok" 2020-07-06T13:19:50.207 INFO:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2020-07-06T13:19:50.207 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:50.207 INFO:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2020-07-06T13:19:50.208 INFO:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2020-07-06T13:19:50.208 INFO:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2020-07-06T13:19:50.208 INFO:teuthology.orchestra.run.smithi148:> return files[0] 2020-07-06T13:19:50.209 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:50.209 INFO:teuthology.orchestra.run.smithi148:> for f in files: 2020-07-06T13:19:50.209 INFO:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-07-06T13:19:50.210 INFO:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2020-07-06T13:19:50.210 INFO:teuthology.orchestra.run.smithi148:> return f 2020-07-06T13:19:50.210 INFO:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-07-06T13:19:50.211 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:50.211 INFO:teuthology.orchestra.run.smithi148:> print(find_socket("client.vol_data_isolated")) 2020-07-06T13:19:50.211 INFO:teuthology.orchestra.run.smithi148:> ' 2020-07-06T13:19:50.292 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.vol_data_isolated.9176.asok 2020-07-06T13:19:50.297 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.vol_data_isolated.9176.asok 2020-07-06T13:19:50.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:50.298 INFO:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.vol_data_isolated.9176.asok status 2020-07-06T13:19:50.373 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2020-07-06T13:19:50.373 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2020-07-06T13:19:50.373 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "564bdc4ae87418a232fc901524470e1a0f76d641", 2020-07-06T13:19:50.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 13.2.10 (564bdc4ae87418a232fc901524470e1a0f76d641) mimic (stable)", 2020-07-06T13:19:50.374 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "vol_data_isolated", 2020-07-06T13:19:50.374 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2020-07-06T13:19:50.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-07-06T13:19:50.374 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "9176", 2020-07-06T13:19:50.375 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/volumes/_nogroup/vol_isolated" 2020-07-06T13:19:50.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:50.375 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2020-07-06T13:19:50.375 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2020-07-06T13:19:50.375 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4354, 2020-07-06T13:19:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2020-07-06T13:19:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2020-07-06T13:19:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2020-07-06T13:19:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4354 2020-07-06T13:19:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:50.377 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2020-07-06T13:19:50.377 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 31167476, 2020-07-06T13:19:50.377 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0" 2020-07-06T13:19:50.377 INFO:teuthology.orchestra.run.smithi148.stdout: } 2020-07-06T13:19:50.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:50.378 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.4354 172.21.15.148:0/31167476", 2020-07-06T13:19:50.378 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "172.21.15.148:0/31167476", 2020-07-06T13:19:50.378 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2020-07-06T13:19:50.378 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 7, 2020-07-06T13:19:50.379 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 26, 2020-07-06T13:19:50.379 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2020-07-06T13:19:50.379 INFO:teuthology.orchestra.run.smithi148.stdout: "blacklisted": false 2020-07-06T13:19:50.379 INFO:teuthology.orchestra.run.smithi148.stdout:} 2020-07-06T13:19:50.380 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:19:50.476 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:50.482 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.483 7f26f5071700 1 Processor -- start 2020-07-06T13:19:50.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.483 7f26f5071700 1 -- - start start 2020-07-06T13:19:50.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.483 7f26f5071700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f014ba90 con 0 2020-07-06T13:19:50.483 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.483 7f26f5071700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f014be30 con 0 2020-07-06T13:19:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.483 7f26ef027700 1 -- 172.21.15.118:0/1219433910 learned_addr learned my addr 172.21.15.118:0/1219433910 2020-07-06T13:19:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26e00039b0 con 0x7f26f0148050 2020-07-06T13:19:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2594866953 0 0) 0x7f26e0003d30 con 0x7f26f0148050 2020-07-06T13:19:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f26d0002a20 con 0 2020-07-06T13:19:50.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26d80022a0 con 0x7f26f014b350 2020-07-06T13:19:50.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1416433588 0 0) 0x7f26d8002620 con 0x7f26f014b350 2020-07-06T13:19:50.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f26d00046c0 con 0 2020-07-06T13:19:50.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (558486599 0 0) 0x7f26e0004300 con 0x7f26f0148050 2020-07-06T13:19:50.486 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 >> 172.21.15.118:6789/0 conn(0x7f26f014b350 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=93 cs=1 l=1).mark_down 2020-07-06T13:19:50.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f007a7f0 con 0 2020-07-06T13:19:50.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f26f00e9f70 con 0x7f26f0148050 2020-07-06T13:19:50.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26ee025700 1 -- 172.21.15.118:0/1219433910 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26e00013d0 con 0x7f26f0148050 2020-07-06T13:19:50.487 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26f5071700 1 -- 172.21.15.118:0/1219433910 >> 172.21.15.118:6790/0 conn(0x7f26f0148050 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-07-06T13:19:50.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26f5071700 1 -- 172.21.15.118:0/1219433910 shutdown_connections 2020-07-06T13:19:50.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26f5071700 1 -- 172.21.15.118:0/1219433910 shutdown_connections 2020-07-06T13:19:50.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26f5071700 1 -- 172.21.15.118:0/1219433910 wait complete. 2020-07-06T13:19:50.488 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.487 7f26f5071700 1 -- 172.21.15.118:0/1219433910 >> 172.21.15.118:0/1219433910 conn(0x7f26f0143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 Processor -- start 2020-07-06T13:19:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 -- - start start 2020-07-06T13:19:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00a3aa0 con 0 2020-07-06T13:19:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00a6870 con 0 2020-07-06T13:19:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ee826700 1 -- 172.21.15.118:0/1895421988 learned_addr learned my addr 172.21.15.118:0/1895421988 2020-07-06T13:19:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26d8002270 con 0x7f26f00a60c0 2020-07-06T13:19:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2118329127 0 0) 0x7f26d80029b0 con 0x7f26f00a60c0 2020-07-06T13:19:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f26d4002960 con 0 2020-07-06T13:19:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26e00011d0 con 0x7f26f00a30b0 2020-07-06T13:19:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1287547738 0 0) 0x7f26e00018f0 con 0x7f26f00a30b0 2020-07-06T13:19:50.493 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f26d4004620 con 0 2020-07-06T13:19:50.493 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2113273191 0 0) 0x7f26d8000f70 con 0x7f26f00a60c0 2020-07-06T13:19:50.493 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26d4002ee0 con 0 2020-07-06T13:19:50.493 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3287009439 0 0) 0x7f26e0001c70 con 0x7f26f00a30b0 2020-07-06T13:19:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26d4003540 con 0 2020-07-06T13:19:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2802694354 0 0) 0x7f26d80015a0 con 0x7f26f00a60c0 2020-07-06T13:19:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 >> 172.21.15.118:6789/0 conn(0x7f26f00a30b0 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-07-06T13:19:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f007aa50 con 0 2020-07-06T13:19:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f00b27b0 con 0 2020-07-06T13:19:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26f5071700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f018b010 con 0 2020-07-06T13:19:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f26f0116e00 con 0x7f26f00a60c0 2020-07-06T13:19:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f26d80019d0 con 0x7f26f00a60c0 2020-07-06T13:19:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f26d80044b0 con 0x7f26f00a60c0 2020-07-06T13:19:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.491 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f26d8005e20 con 0x7f26f00a60c0 2020-07-06T13:19:50.496 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.495 7f26f5071700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c8002050 con 0 2020-07-06T13:19:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.503 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f26d8003f90 con 0x7f26f00a60c0 2020-07-06T13:19:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c8001200 con 0 2020-07-06T13:19:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26ec822700 1 -- 172.21.15.118:0/1895421988 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+7457 (675718476 0 1658814372) 0x7f26d8006100 con 0x7f26f00a60c0 2020-07-06T13:19:50.594 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:50.594 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":26,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:19:47.406225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"fsvolume_vol_isolated","create_time":"2020-07-06 13:19:39.526679","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":3997,"pg_placement_num":3997,"last_change":"19","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:19:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 >> 172.21.15.118:6800/9723 conn(0x7f26d4006ef0 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-07-06T13:19:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 >> 172.21.15.118:6790/0 conn(0x7f26f00a60c0 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-07-06T13:19:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 shutdown_connections 2020-07-06T13:19:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 shutdown_connections 2020-07-06T13:19:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 wait complete. 2020-07-06T13:19:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.595 7f26f5071700 1 -- 172.21.15.118:0/1895421988 >> 172.21.15.118:0/1895421988 conn(0x7f26f00992f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:50.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-06 13:18:56.457152', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2020-07-06 13:18:56.782594', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'fsvolume_vol_isolated', 'create_time': '2020-07-06 13:19:39.526679', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 3997, 'pg_placement_num': 3997, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-06T13:19:50.605 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:19:50.686 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:50.695 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.695 7f1abcf75700 1 Processor -- start 2020-07-06T13:19:50.696 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.695 7f1abcf75700 1 -- - start start 2020-07-06T13:19:50.697 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab814ba70 con 0 2020-07-06T13:19:50.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab814be10 con 0 2020-07-06T13:19:50.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab6570700 1 -- 172.21.15.118:0/2763300584 learned_addr learned my addr 172.21.15.118:0/2763300584 2020-07-06T13:19:50.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1ab0002620 con 0x7f1ab8148030 2020-07-06T13:19:50.698 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3786076011 0 0) 0x7f1ab00029a0 con 0x7f1ab8148030 2020-07-06T13:19:50.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a9c002a20 con 0 2020-07-06T13:19:50.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1aac0035b0 con 0x7f1ab814b330 2020-07-06T13:19:50.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2047292841 0 0) 0x7f1aac003930 con 0x7f1ab814b330 2020-07-06T13:19:50.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a9c0046c0 con 0 2020-07-06T13:19:50.699 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (181022017 0 0) 0x7f1ab0002f70 con 0x7f1ab8148030 2020-07-06T13:19:50.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 >> 172.21.15.118:6789/0 conn(0x7f1ab814b330 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-07-06T13:19:50.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab807a900 con 0 2020-07-06T13:19:50.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1ab80e9f50 con 0x7f1ab8148030 2020-07-06T13:19:50.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1ab5d6f700 1 -- 172.21.15.118:0/2763300584 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1ab00013d0 con 0x7f1ab8148030 2020-07-06T13:19:50.700 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- 172.21.15.118:0/2763300584 >> 172.21.15.118:6791/0 conn(0x7f1ab8148030 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-07-06T13:19:50.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- 172.21.15.118:0/2763300584 shutdown_connections 2020-07-06T13:19:50.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- 172.21.15.118:0/2763300584 shutdown_connections 2020-07-06T13:19:50.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- 172.21.15.118:0/2763300584 wait complete. 2020-07-06T13:19:50.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.699 7f1abcf75700 1 -- 172.21.15.118:0/2763300584 >> 172.21.15.118:0/2763300584 conn(0x7f1ab8143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:50.703 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 Processor -- start 2020-07-06T13:19:50.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 -- - start start 2020-07-06T13:19:50.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80a3d10 con 0 2020-07-06T13:19:50.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80a51c0 con 0 2020-07-06T13:19:50.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1ab6570700 1 -- 172.21.15.118:0/1730455698 learned_addr learned my addr 172.21.15.118:0/1730455698 2020-07-06T13:19:50.704 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1aac0033f0 con 0x7f1ab8095c50 2020-07-06T13:19:50.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2005626548 0 0) 0x7f1aac003c70 con 0x7f1ab8095c50 2020-07-06T13:19:50.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a94002960 con 0 2020-07-06T13:19:50.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1ab00011d0 con 0x7f1ab80a3410 2020-07-06T13:19:50.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (187142830 0 0) 0x7f1ab0002370 con 0x7f1ab80a3410 2020-07-06T13:19:50.705 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a94004620 con 0 2020-07-06T13:19:50.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2483086985 0 0) 0x7f1aac000e50 con 0x7f1ab8095c50 2020-07-06T13:19:50.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1a94002ee0 con 0 2020-07-06T13:19:50.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3882467583 0 0) 0x7f1ab0002810 con 0x7f1ab80a3410 2020-07-06T13:19:50.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1a94003540 con 0 2020-07-06T13:19:50.706 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2467044416 0 0) 0x7f1aac001390 con 0x7f1ab8095c50 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 >> 172.21.15.118:6791/0 conn(0x7f1ab80a3410 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab807ab60 con 0 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8072be0 con 0 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80a68e0 con 0 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1ab8116de0 con 0x7f1ab8095c50 2020-07-06T13:19:50.707 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f1aac001600 con 0x7f1ab8095c50 2020-07-06T13:19:50.708 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f1aac004260 con 0x7f1ab8095c50 2020-07-06T13:19:50.708 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.703 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f1aac005f40 con 0x7f1ab8095c50 2020-07-06T13:19:50.711 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.711 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab807af00 con 0 2020-07-06T13:19:50.715 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.715 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1ab807af00 con 0x7f1ab8095c50 2020-07-06T13:19:50.808 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1ab80732f0 con 0 2020-07-06T13:19:50.809 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1aa7fff700 1 -- 172.21.15.118:0/1730455698 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v26) v1 ==== 92+0+10 (964071824 0 265718887) 0x7f1aac001840 con 0x7f1ab8095c50 2020-07-06T13:19:50.809 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:50.811 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 >> 172.21.15.118:6800/9723 conn(0x7f1a94006180 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-07-06T13:19:50.811 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 >> 172.21.15.118:6789/0 conn(0x7f1ab8095c50 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-07-06T13:19:50.811 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 shutdown_connections 2020-07-06T13:19:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 shutdown_connections 2020-07-06T13:19:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 wait complete. 2020-07-06T13:19:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.811 7f1abcf75700 1 -- 172.21.15.118:0/1730455698 >> 172.21.15.118:0/1730455698 conn(0x7f1ab8099520 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:50.821 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-06T13:19:50.902 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:50.911 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.911 7fe70052d700 1 Processor -- start 2020-07-06T13:19:50.912 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.911 7fe70052d700 1 -- - start start 2020-07-06T13:19:50.913 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f814ba70 con 0 2020-07-06T13:19:50.913 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f814be10 con 0 2020-07-06T13:19:50.913 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fe553700 1 -- 172.21.15.118:0/3660221433 learned_addr learned my addr 172.21.15.118:0/3660221433 2020-07-06T13:19:50.913 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6e80039b0 con 0x7fe6f8148030 2020-07-06T13:19:50.913 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6ec002220 con 0x7fe6f814b330 2020-07-06T13:19:50.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2386419708 0 0) 0x7fe6e8003d30 con 0x7fe6f8148030 2020-07-06T13:19:50.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe6e4002f40 con 0 2020-07-06T13:19:50.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1004905257 0 0) 0x7fe6ec002520 con 0x7fe6f814b330 2020-07-06T13:19:50.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe6e4004750 con 0 2020-07-06T13:19:50.915 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3829966785 0 0) 0x7fe6ec002910 con 0x7fe6f814b330 2020-07-06T13:19:50.915 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 >> 172.21.15.118:6791/0 conn(0x7fe6f8148030 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-07-06T13:19:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f807a900 con 0 2020-07-06T13:19:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe6f8116de0 con 0x7fe6f814b330 2020-07-06T13:19:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- 172.21.15.118:0/3660221433 >> 172.21.15.118:6789/0 conn(0x7fe6f814b330 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-07-06T13:19:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe6fd551700 1 -- 172.21.15.118:0/3660221433 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6ec000e50 con 0x7fe6f814b330 2020-07-06T13:19:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- 172.21.15.118:0/3660221433 shutdown_connections 2020-07-06T13:19:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- 172.21.15.118:0/3660221433 shutdown_connections 2020-07-06T13:19:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- 172.21.15.118:0/3660221433 wait complete. 2020-07-06T13:19:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.915 7fe70052d700 1 -- 172.21.15.118:0/3660221433 >> 172.21.15.118:0/3660221433 conn(0x7fe6f8143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:50.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 Processor -- start 2020-07-06T13:19:50.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 -- - start start 2020-07-06T13:19:50.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80a3d40 con 0 2020-07-06T13:19:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80a6b10 con 0 2020-07-06T13:19:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6fe553700 1 -- 172.21.15.118:0/4027546919 learned_addr learned my addr 172.21.15.118:0/4027546919 2020-07-06T13:19:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6e8004360 con 0x7fe6f80a3350 2020-07-06T13:19:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3689812543 0 0) 0x7fe6e8003870 con 0x7fe6f80a3350 2020-07-06T13:19:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe6d80029c0 con 0 2020-07-06T13:19:50.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6ec002910 con 0x7fe6f80a6360 2020-07-06T13:19:50.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2843609741 0 0) 0x7fe6ec002030 con 0x7fe6f80a6360 2020-07-06T13:19:50.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe6d8004680 con 0 2020-07-06T13:19:50.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (183370075 0 0) 0x7fe6e80011d0 con 0x7fe6f80a3350 2020-07-06T13:19:50.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6d8002f40 con 0 2020-07-06T13:19:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2725011770 0 0) 0x7fe6ec0022a0 con 0x7fe6f80a6360 2020-07-06T13:19:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6d80035a0 con 0 2020-07-06T13:19:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3571707280 0 0) 0x7fe6e80016e0 con 0x7fe6f80a3350 2020-07-06T13:19:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 >> 172.21.15.118:6790/0 conn(0x7fe6f80a6360 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-07-06T13:19:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f807ab60 con 0 2020-07-06T13:19:50.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f80712b0 con 0 2020-07-06T13:19:50.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe70052d700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f818b160 con 0 2020-07-06T13:19:50.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe6e8000f70 con 0x7fe6f80a3350 2020-07-06T13:19:50.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe6e8001b10 con 0x7fe6f80a3350 2020-07-06T13:19:50.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fe6e8004b00 con 0x7fe6f80a3350 2020-07-06T13:19:50.924 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.919 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fe6e80064c0 con 0x7fe6f80a3350 2020-07-06T13:19:50.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.927 7fe70052d700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f807af00 con 0 2020-07-06T13:19:50.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:50.935 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe6f807af00 con 0x7fe6f80a3350 2020-07-06T13:19:51.021 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe6f8156330 con 0 2020-07-06T13:19:51.022 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe6f77fe700 1 -- 172.21.15.118:0/4027546919 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v26) v1 ==== 104+0+10 (2391828516 0 265718887) 0x7fe6e8004ea0 con 0x7fe6f80a3350 2020-07-06T13:19:51.022 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:51.023 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 >> 172.21.15.118:6800/9723 conn(0x7fe6d8006ed0 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-07-06T13:19:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 >> 172.21.15.118:6789/0 conn(0x7fe6f80a3350 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-07-06T13:19:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 shutdown_connections 2020-07-06T13:19:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 shutdown_connections 2020-07-06T13:19:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 wait complete. 2020-07-06T13:19:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.023 7fe70052d700 1 -- 172.21.15.118:0/4027546919 >> 172.21.15.118:0/4027546919 conn(0x7fe6f8099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.034 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-06T13:19:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:51.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.127 7f9067c0d700 1 Processor -- start 2020-07-06T13:19:51.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.127 7f9067c0d700 1 -- - start start 2020-07-06T13:19:51.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.127 7f9067c0d700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906014ba80 con 0 2020-07-06T13:19:51.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.127 7f9067c0d700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906014be20 con 0 2020-07-06T13:19:51.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9065c33700 1 -- 172.21.15.118:0/780827841 learned_addr learned my addr 172.21.15.118:0/780827841 2020-07-06T13:19:51.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9050003630 con 0x7f9060148040 2020-07-06T13:19:51.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f905c0022a0 con 0x7f906014b340 2020-07-06T13:19:51.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3948801072 0 0) 0x7f90500039b0 con 0x7f9060148040 2020-07-06T13:19:51.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f904c002ea0 con 0 2020-07-06T13:19:51.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1130670115 0 0) 0x7f905c002620 con 0x7f906014b340 2020-07-06T13:19:51.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f904c0046b0 con 0 2020-07-06T13:19:51.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (459577527 0 0) 0x7f9050003ea0 con 0x7f9060148040 2020-07-06T13:19:51.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 >> 172.21.15.118:6790/0 conn(0x7f906014b340 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-07-06T13:19:51.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906007a910 con 0 2020-07-06T13:19:51.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f90600e9f60 con 0x7f9060148040 2020-07-06T13:19:51.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9064c31700 1 -- 172.21.15.118:0/780827841 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9050001010 con 0x7f9060148040 2020-07-06T13:19:51.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- 172.21.15.118:0/780827841 >> 172.21.15.118:6791/0 conn(0x7f9060148040 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-07-06T13:19:51.134 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- 172.21.15.118:0/780827841 shutdown_connections 2020-07-06T13:19:51.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- 172.21.15.118:0/780827841 shutdown_connections 2020-07-06T13:19:51.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- 172.21.15.118:0/780827841 wait complete. 2020-07-06T13:19:51.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- 172.21.15.118:0/780827841 >> 172.21.15.118:0/780827841 conn(0x7f9060143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 Processor -- start 2020-07-06T13:19:51.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.131 7f9067c0d700 1 -- - start start 2020-07-06T13:19:51.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9067c0d700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600a3d10 con 0 2020-07-06T13:19:51.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9067c0d700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600a6980 con 0 2020-07-06T13:19:51.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9065c33700 1 -- 172.21.15.118:0/3911864716 learned_addr learned my addr 172.21.15.118:0/3911864716 2020-07-06T13:19:51.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f905c0020e0 con 0x7f90600a6330 2020-07-06T13:19:51.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (765515682 0 0) 0x7f905c0029a0 con 0x7f90600a6330 2020-07-06T13:19:51.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9040002960 con 0 2020-07-06T13:19:51.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9050000e50 con 0x7f90600a3320 2020-07-06T13:19:51.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1085076835 0 0) 0x7f90500033e0 con 0x7f90600a3320 2020-07-06T13:19:51.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9040004620 con 0 2020-07-06T13:19:51.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2626619608 0 0) 0x7f9050003650 con 0x7f90600a3320 2020-07-06T13:19:51.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9040002ee0 con 0 2020-07-06T13:19:51.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3146969953 0 0) 0x7f905c000e50 con 0x7f90600a6330 2020-07-06T13:19:51.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9040003540 con 0 2020-07-06T13:19:51.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1706978179 0 0) 0x7f9050001530 con 0x7f90600a3320 2020-07-06T13:19:51.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 >> 172.21.15.118:6791/0 conn(0x7f90600a6330 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-07-06T13:19:51.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906007ab70 con 0 2020-07-06T13:19:51.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060072b00 con 0 2020-07-06T13:19:51.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f906018b050 con 0 2020-07-06T13:19:51.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9050000bf0 con 0x7f90600a3320 2020-07-06T13:19:51.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f9050001960 con 0x7f90600a3320 2020-07-06T13:19:51.140 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f9050001ba0 con 0x7f90600a3320 2020-07-06T13:19:51.140 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.135 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f9050005ee0 con 0x7f90600a3320 2020-07-06T13:19:51.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.143 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c002050 con 0 2020-07-06T13:19:51.147 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.147 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f9050004150 con 0x7f90600a3320 2020-07-06T13:19:51.241 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f903c001280 con 0 2020-07-06T13:19:51.242 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9056ffd700 1 -- 172.21.15.118:0/3911864716 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v26) v1 ==== 100+0+10 (2688139813 0 265718887) 0x7f9050006180 con 0x7f90600a3320 2020-07-06T13:19:51.242 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:19:51.243 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 >> 172.21.15.118:6800/9723 conn(0x7f9040006ed0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-07-06T13:19:51.243 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 >> 172.21.15.118:6789/0 conn(0x7f90600a3320 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-07-06T13:19:51.244 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 shutdown_connections 2020-07-06T13:19:51.244 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 shutdown_connections 2020-07-06T13:19:51.244 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 wait complete. 2020-07-06T13:19:51.244 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.243 7f9067c0d700 1 -- 172.21.15.118:0/3911864716 >> 172.21.15.118:0/3911864716 conn(0x7f9060099430 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.253 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get fsvolume_vol_isolated pg_num 2020-07-06T13:19:51.337 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:51.346 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7bae51700 1 Processor -- start 2020-07-06T13:19:51.346 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7bae51700 1 -- - start start 2020-07-06T13:19:51.347 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7bae51700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b414ba70 con 0 2020-07-06T13:19:51.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7bae51700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b414be10 con 0 2020-07-06T13:19:51.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b3fff700 1 -- 172.21.15.118:0/1982946253 learned_addr learned my addr 172.21.15.118:0/1982946253 2020-07-06T13:19:51.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe7a4003630 con 0x7fe7b414b330 2020-07-06T13:19:51.348 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe79c0022a0 con 0x7fe7b4148030 2020-07-06T13:19:51.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3973116082 0 0) 0x7fe7a40039b0 con 0x7fe7b414b330 2020-07-06T13:19:51.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe794002ea0 con 0 2020-07-06T13:19:51.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (108732304 0 0) 0x7fe79c0025a0 con 0x7fe7b4148030 2020-07-06T13:19:51.349 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.347 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe7940046a0 con 0 2020-07-06T13:19:51.350 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1381839703 0 0) 0x7fe7a4003e50 con 0x7fe7b414b330 2020-07-06T13:19:51.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 >> 172.21.15.118:6790/0 conn(0x7fe7b4148030 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-07-06T13:19:51.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b407a900 con 0 2020-07-06T13:19:51.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe7a4000bf0 con 0x7fe7b414b330 2020-07-06T13:19:51.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7b37fe700 1 -- 172.21.15.118:0/1982946253 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe7a4001010 con 0x7fe7b414b330 2020-07-06T13:19:51.351 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7bae51700 1 -- 172.21.15.118:0/1982946253 >> 172.21.15.118:6789/0 conn(0x7fe7b414b330 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-07-06T13:19:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7bae51700 1 -- 172.21.15.118:0/1982946253 shutdown_connections 2020-07-06T13:19:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7bae51700 1 -- 172.21.15.118:0/1982946253 shutdown_connections 2020-07-06T13:19:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7bae51700 1 -- 172.21.15.118:0/1982946253 wait complete. 2020-07-06T13:19:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.351 7fe7bae51700 1 -- 172.21.15.118:0/1982946253 >> 172.21.15.118:0/1982946253 conn(0x7fe7b4143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 Processor -- start 2020-07-06T13:19:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 -- - start start 2020-07-06T13:19:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b409fdd0 con 0 2020-07-06T13:19:51.354 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40a2b10 con 0 2020-07-06T13:19:51.354 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b3fff700 1 -- 172.21.15.118:0/272049480 learned_addr learned my addr 172.21.15.118:0/272049480 2020-07-06T13:19:51.355 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe7a4000e50 con 0x7fe7b40a2360 2020-07-06T13:19:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe79c002ae0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (220808337 0 0) 0x7fe7a40033e0 con 0x7fe7b40a2360 2020-07-06T13:19:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe798002df0 con 0 2020-07-06T13:19:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (797017565 0 0) 0x7fe79c002080 con 0x7fe7b409f3e0 2020-07-06T13:19:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe798004620 con 0 2020-07-06T13:19:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2751581398 0 0) 0x7fe79c002440 con 0x7fe7b409f3e0 2020-07-06T13:19:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe798004df0 con 0 2020-07-06T13:19:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3559108568 0 0) 0x7fe7a40037b0 con 0x7fe7b40a2360 2020-07-06T13:19:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe798006570 con 0 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1571581747 0 0) 0x7fe79c0010f0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 >> 172.21.15.118:6791/0 conn(0x7fe7b40a2360 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b407ab60 con 0 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40714d0 con 0 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7bae51700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b418b450 con 0 2020-07-06T13:19:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe79c000bf0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.359 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fe79c001360 con 0x7fe7b409f3e0 2020-07-06T13:19:51.359 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fe79c002ed0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.359 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.355 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fe79c0033e0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.361 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.363 7fe7bae51700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b407af00 con 0 2020-07-06T13:19:51.365 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.367 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe7b407af00 con 0x7fe7b409f3e0 2020-07-06T13:19:51.457 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"} v 0) v1 -- 0x7fe7b4156330 con 0 2020-07-06T13:19:51.458 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7b1ffb700 1 -- 172.21.15.118:0/272049480 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"}]=0 v26) v1 ==== 110+0+13 (28688288 0 66981700) 0x7fe79c003af0 con 0x7fe7b409f3e0 2020-07-06T13:19:51.458 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 3997 2020-07-06T13:19:51.459 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 >> 172.21.15.118:6800/9723 conn(0x7fe7980072a0 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-07-06T13:19:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 >> 172.21.15.118:6790/0 conn(0x7fe7b409f3e0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-07-06T13:19:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 shutdown_connections 2020-07-06T13:19:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 shutdown_connections 2020-07-06T13:19:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 wait complete. 2020-07-06T13:19:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.459 7fe7bae51700 1 -- 172.21.15.118:0/272049480 >> 172.21.15.118:0/272049480 conn(0x7fe7b4178180 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.474 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-07-06T13:19:51.475 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:19:51.549 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:19:51.554 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8ae508700 1 Processor -- start 2020-07-06T13:19:51.554 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8ae508700 1 -- - start start 2020-07-06T13:19:51.556 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8ae508700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a814ba90 con 0 2020-07-06T13:19:51.556 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8ae508700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a814be30 con 0 2020-07-06T13:19:51.556 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a7fff700 1 -- 172.21.15.118:0/1462133662 learned_addr learned my addr 172.21.15.118:0/1462133662 2020-07-06T13:19:51.557 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8a0003630 con 0x7ff8a8148050 2020-07-06T13:19:51.557 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3356742508 0 0) 0x7ff8a00039b0 con 0x7ff8a8148050 2020-07-06T13:19:51.557 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff888002a20 con 0 2020-07-06T13:19:51.557 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8900022a0 con 0x7ff8a814b350 2020-07-06T13:19:51.557 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3754492144 0 0) 0x7ff890002620 con 0x7ff8a814b350 2020-07-06T13:19:51.558 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff8880046c0 con 0 2020-07-06T13:19:51.558 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (418437086 0 0) 0x7ff8a0003f80 con 0x7ff8a8148050 2020-07-06T13:19:51.558 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 >> 172.21.15.118:6790/0 conn(0x7ff8a814b350 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-07-06T13:19:51.558 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.555 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a807a7f0 con 0 2020-07-06T13:19:51.558 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff8a80e9f70 con 0x7ff8a8148050 2020-07-06T13:19:51.559 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- 172.21.15.118:0/1462133662 >> 172.21.15.118:6791/0 conn(0x7ff8a8148050 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-07-06T13:19:51.559 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a6ffd700 1 -- 172.21.15.118:0/1462133662 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8a0001050 con 0x7ff8a8148050 2020-07-06T13:19:51.561 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- 172.21.15.118:0/1462133662 shutdown_connections 2020-07-06T13:19:51.561 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- 172.21.15.118:0/1462133662 shutdown_connections 2020-07-06T13:19:51.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- 172.21.15.118:0/1462133662 wait complete. 2020-07-06T13:19:51.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- 172.21.15.118:0/1462133662 >> 172.21.15.118:0/1462133662 conn(0x7ff8a8143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 Processor -- start 2020-07-06T13:19:51.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- - start start 2020-07-06T13:19:51.562 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a80a3b50 con 0 2020-07-06T13:19:51.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8ae508700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a80a6920 con 0 2020-07-06T13:19:51.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a7fff700 1 -- 172.21.15.118:0/2602021311 learned_addr learned my addr 172.21.15.118:0/2602021311 2020-07-06T13:19:51.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8a0000e50 con 0x7ff8a80a3160 2020-07-06T13:19:51.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1367660800 0 0) 0x7ff8a0001570 con 0x7ff8a80a3160 2020-07-06T13:19:51.563 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff88c002960 con 0 2020-07-06T13:19:51.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8900020b0 con 0x7ff8a80a6170 2020-07-06T13:19:51.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (754425884 0 0) 0x7ff8900029b0 con 0x7ff8a80a6170 2020-07-06T13:19:51.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff88c004620 con 0 2020-07-06T13:19:51.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (514927712 0 0) 0x7ff8a00018f0 con 0x7ff8a80a3160 2020-07-06T13:19:51.564 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff88c002ee0 con 0 2020-07-06T13:19:51.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3560253884 0 0) 0x7ff890000e50 con 0x7ff8a80a6170 2020-07-06T13:19:51.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.559 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff88c003540 con 0 2020-07-06T13:19:51.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2539711196 0 0) 0x7ff8a0003620 con 0x7ff8a80a3160 2020-07-06T13:19:51.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 >> 172.21.15.118:6789/0 conn(0x7ff8a80a6170 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-07-06T13:19:51.565 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a807aa50 con 0 2020-07-06T13:19:51.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a80b2550 con 0 2020-07-06T13:19:51.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a818b0f0 con 0 2020-07-06T13:19:51.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff8a0001360 con 0x7ff8a80a3160 2020-07-06T13:19:51.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8a0003a50 con 0x7ff8a80a3160 2020-07-06T13:19:51.566 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7ff8a0004990 con 0x7ff8a80a3160 2020-07-06T13:19:51.567 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.563 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7ff8a0004d10 con 0x7ff8a80a3160 2020-07-06T13:19:51.569 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.571 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a807add0 con 0 2020-07-06T13:19:51.575 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.575 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff8a807add0 con 0x7ff8a80a3160 2020-07-06T13:19:51.663 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.663 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8a80730f0 con 0 2020-07-06T13:19:51.664 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.663 7ff8a57fa700 1 -- 172.21.15.118:0/2602021311 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2251 (4058427516 0 3147250658) 0x7ff8a0004470 con 0x7ff8a80a3160 2020-07-06T13:19:51.664 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2020-07-06T13:19:51.664 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:19:51.665 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:19:40.336529","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:19:51.666 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 >> 172.21.15.118:6800/9723 conn(0x7ff88c006ed0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-07-06T13:19:51.666 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 >> 172.21.15.118:6790/0 conn(0x7ff8a80a3160 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-07-06T13:19:51.666 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 shutdown_connections 2020-07-06T13:19:51.666 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 shutdown_connections 2020-07-06T13:19:51.667 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 wait complete. 2020-07-06T13:19:51.667 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:19:51.667 7ff8ae508700 1 -- 172.21.15.118:0/2602021311 >> 172.21.15.118:0/2602021311 conn(0x7ff8a8099290 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:19:51.980 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-06 13:18:57.751069', 'modified': '2020-07-06 13:19:40.336529', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4211': {'gid': 4211, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.118:6819/1597074397', 'standby_for_rank': -1, 'standby_for_fscid': -1, 'standby_for_name': '', 'standby_replay': False, 'export_targets': [], 'features': 4611087854031667195}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-06T13:19:51.981 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-06T13:19:51.982 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-07-06T13:19:52.065 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","whoami":0,"id":4211,"want_state":"up:active","state":"up:active","rank_uptime":52.299599,"mdsmap_epoch":7,"osdmap_epoch":26,"osdmap_epoch_barrier":18,"uptime":52.719716} 2020-07-06T13:19:52.071 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "74e2240b-47f9-4a3f-ade9-f9f65278ae84", "id": 4211, "mdsmap_epoch": 7, "osdmap_epoch": 26, "osdmap_epoch_barrier": 18, "rank_uptime": 52.299599, "state": "up:active", "uptime": 52.719716, "want_state": "up:active", "whoami": 0 } 2020-07-06T13:19:52.072 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-07-06T13:19:52.072 INFO:tasks.cephfs.fuse_mount:Client client.vol_default config is {'auth_id': 'vol_default', 'mount_path': '/volumes/_nogroup/vol_default', 'mountpoint': 'mnt.1'} 2020-07-06T13:19:52.072 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.vol_default at ubuntu@smithi148.front.sepia.ceph.com mnt.1... 2020-07-06T13:19:52.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:52.073 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec mkdir -p mnt.1) 2020-07-06T13:19:52.082 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:52.140 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:52.140 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:52.194 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:52.195 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:52.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:52.196 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:52.243 INFO:teuthology.orchestra.run.smithi148.stdout:49 2020-07-06T13:19:52.244 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2020-07-06T13:19:52.244 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --client_mountpoint=/volumes/_nogroup/vol_default --name client.vol_default mnt.1) 2020-07-06T13:19:52.287 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:52.301 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:52.302 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:52.359 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:52.360 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:52.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:52.361 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:52.362 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_default.smithi148.stderr:2020-07-06 13:19:52.361 7f783bc41b80 -1 init, newargv = 0x5556b038c940 newargc=7ceph-fuse[9234]: starting ceph client 2020-07-06T13:19:52.362 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_default.smithi148.stderr: 2020-07-06T13:19:52.365 INFO:teuthology.orchestra.run.smithi148.stdout:49 2020-07-06T13:19:52.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.vol_default.smithi148.stderr:ceph-fuse[9234]: starting fuse 2020-07-06T13:19:53.467 INFO:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2020-07-06T13:19:53.482 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-07-06T13:19:53.483 INFO:teuthology.orchestra.run.smithi148:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-07-06T13:19:53.539 INFO:teuthology.orchestra.run.smithi148.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-07-06T13:19:53.540 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-07-06T13:19:53.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.541 INFO:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2020-07-06T13:19:53.587 INFO:teuthology.orchestra.run.smithi148.stdout:49 2020-07-06T13:19:53.587 INFO:teuthology.orchestra.run.smithi148.stdout:50 2020-07-06T13:19:53.588 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2020-07-06T13:19:53.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.589 INFO:teuthology.orchestra.run.smithi148:> sudo python3 -c ' 2020-07-06T13:19:53.589 INFO:teuthology.orchestra.run.smithi148:> import glob 2020-07-06T13:19:53.589 INFO:teuthology.orchestra.run.smithi148:> import re 2020-07-06T13:19:53.590 INFO:teuthology.orchestra.run.smithi148:> import os 2020-07-06T13:19:53.590 INFO:teuthology.orchestra.run.smithi148:> import subprocess 2020-07-06T13:19:53.590 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:53.591 INFO:teuthology.orchestra.run.smithi148:> def find_socket(client_name): 2020-07-06T13:19:53.591 INFO:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.vol_default.*.asok" 2020-07-06T13:19:53.591 INFO:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2020-07-06T13:19:53.592 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:53.592 INFO:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2020-07-06T13:19:53.593 INFO:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2020-07-06T13:19:53.593 INFO:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2020-07-06T13:19:53.593 INFO:teuthology.orchestra.run.smithi148:> return files[0] 2020-07-06T13:19:53.594 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:53.594 INFO:teuthology.orchestra.run.smithi148:> for f in files: 2020-07-06T13:19:53.594 INFO:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-07-06T13:19:53.595 INFO:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2020-07-06T13:19:53.595 INFO:teuthology.orchestra.run.smithi148:> return f 2020-07-06T13:19:53.595 INFO:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-07-06T13:19:53.596 INFO:teuthology.orchestra.run.smithi148:> 2020-07-06T13:19:53.596 INFO:teuthology.orchestra.run.smithi148:> print(find_socket("client.vol_default")) 2020-07-06T13:19:53.596 INFO:teuthology.orchestra.run.smithi148:> ' 2020-07-06T13:19:53.674 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.vol_default.9234.asok 2020-07-06T13:19:53.678 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.vol_default.9234.asok 2020-07-06T13:19:53.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.679 INFO:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.vol_default.9234.asok status 2020-07-06T13:19:53.750 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2020-07-06T13:19:53.750 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2020-07-06T13:19:53.751 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "564bdc4ae87418a232fc901524470e1a0f76d641", 2020-07-06T13:19:53.751 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 13.2.10 (564bdc4ae87418a232fc901524470e1a0f76d641) mimic (stable)", 2020-07-06T13:19:53.751 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "vol_default", 2020-07-06T13:19:53.751 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2020-07-06T13:19:53.751 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "9234", 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/volumes/_nogroup/vol_default" 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2020-07-06T13:19:53.752 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4381, 2020-07-06T13:19:53.753 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2020-07-06T13:19:53.753 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2020-07-06T13:19:53.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2020-07-06T13:19:53.753 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4381 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 2194155115, 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0" 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: } 2020-07-06T13:19:53.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2020-07-06T13:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.4381 172.21.15.148:0/2194155115", 2020-07-06T13:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "172.21.15.148:0/2194155115", 2020-07-06T13:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2020-07-06T13:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 7, 2020-07-06T13:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 26, 2020-07-06T13:19:53.756 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2020-07-06T13:19:53.756 INFO:teuthology.orchestra.run.smithi148.stdout: "blacklisted": false 2020-07-06T13:19:53.756 INFO:teuthology.orchestra.run.smithi148.stdout:} 2020-07-06T13:19:53.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.758 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-07-06T13:19:53.758 INFO:teuthology.orchestra.run.smithi148:> ' -- mnt.0) 2020-07-06T13:19:53.768 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2020-07-06T13:19:53.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on mnt.0 2020-07-06T13:19:53.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.769 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 mnt.0) 2020-07-06T13:19:53.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.829 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-07-06T13:19:53.830 INFO:teuthology.orchestra.run.smithi148:> ' -- mnt.1) 2020-07-06T13:19:53.878 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2020-07-06T13:19:53.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on mnt.1 2020-07-06T13:19:53.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:19:53.880 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 mnt.1) 2020-07-06T13:19:53.940 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:19:53.954 INFO:teuthology.task.print:**** ceph-fuse vol_isolated 2020-07-06T13:19:53.955 INFO:teuthology.run_tasks:Running task workunit... 2020-07-06T13:19:53.966 INFO:tasks.workunit:Pulling workunits from ref 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:19:53.967 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-07-06T13:19:53.967 INFO:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:53.988 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:53.988 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-07-06T13:19:53.988 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 31h/49d Inode: 1 Links: 2 2020-07-06T13:19:53.989 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:19:53.989 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2020-07-06 13:19:39.456790363 +0000 2020-07-06T13:19:53.989 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2020-07-06 13:19:39.456790363 +0000 2020-07-06T13:19:53.989 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2020-07-06 13:19:53.827697539 +0000 2020-07-06T13:19:53.989 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2020-07-06T13:19:53.990 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-07-06T13:19:53.990 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-07-06T13:19:54.056 INFO:tasks.workunit:timeout=3h 2020-07-06T13:19:54.057 INFO:tasks.workunit:cleanup=False 2020-07-06T13:19:54.058 INFO:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:19:54.105 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-07-06T13:20:27.358 INFO:tasks.workunit.client.0.smithi148.stderr:Note: checking out '754758768dacbb43223ce6879371b1e2ab6a4c92'. 2020-07-06T13:20:27.359 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:20:27.359 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-07-06T13:20:27.359 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2020-07-06T13:20:27.359 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by performing another checkout. 2020-07-06T13:20:27.359 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:20:27.360 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2020-07-06T13:20:27.360 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-07-06T13:20:27.360 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:20:27.360 INFO:tasks.workunit.client.0.smithi148.stderr: git checkout -b 2020-07-06T13:20:27.360 INFO:tasks.workunit.client.0.smithi148.stderr: 2020-07-06T13:20:27.361 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 754758768d Merge pull request #35885 from rhcs-dashboard/wip-46313-octopus 2020-07-06T13:20:27.363 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-07-06T13:20:27.410 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-07-06T13:20:27.413 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-07-06T13:20:27.414 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-07-06T13:20:27.477 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-07-06T13:20:27.544 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-07-06T13:20:27.602 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-07-06T13:20:27.604 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-07-06T13:20:27.604 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-07-06T13:20:27.660 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-07-06T13:20:27.717 DEBUG:teuthology.orchestra.remote:smithi148:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-07-06T13:20:27.729 INFO:tasks.workunit:Running workunits matching fs/upgrade/volume_client on client.0... 2020-07-06T13:20:27.729 INFO:tasks.workunit:Running workunit fs/upgrade/volume_client... 2020-07-06T13:20:27.729 INFO:teuthology.orchestra.run.smithi148:workunit test fs/upgrade/volume_client> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=754758768dacbb43223ce6879371b1e2ab6a4c92 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ACTION=populate adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/upgrade/volume_client 2020-07-06T13:20:27.764 INFO:tasks.workunit.client.0.smithi148.stderr:+ PYTHON=python2 2020-07-06T13:20:27.765 INFO:tasks.workunit.client.0.smithi148.stderr:+ main populate 2020-07-06T13:20:27.765 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' populate = create ']' 2020-07-06T13:20:27.765 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' populate = populate ']' 2020-07-06T13:20:27.765 INFO:tasks.workunit.client.0.smithi148.stderr:+ populate 2020-07-06T13:20:27.765 INFO:tasks.workunit.client.0.smithi148.stderr:+ pwd 2020-07-06T13:20:27.766 INFO:tasks.workunit.client.0.smithi148.stderr:+ df -h . 2020-07-06T13:20:27.766 INFO:tasks.workunit.client.0.smithi148.stdout:/home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-07-06T13:20:27.776 INFO:tasks.workunit.client.0.smithi148.stdout:Filesystem Size Used Avail Use% Mounted on 2020-07-06T13:20:27.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-fuse 8.0G 0 8.0G 0% /home/ubuntu/cephtest/mnt.0 2020-07-06T13:20:27.776 INFO:tasks.workunit.client.0.smithi148.stderr:+ ls -l 2020-07-06T13:20:27.778 INFO:tasks.workunit.client.0.smithi148.stdout:total 0 2020-07-06T13:20:27.779 INFO:tasks.workunit.client.0.smithi148.stderr:+ cp -a /usr/bin . 2020-07-06T13:21:01.555 INFO:tasks.workunit:Stopping ['fs/upgrade/volume_client'] on client.0... 2020-07-06T13:21:01.556 INFO:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-07-06T13:21:01.814 DEBUG:teuthology.parallel:result is None 2020-07-06T13:21:01.815 INFO:teuthology.run_tasks:Running task workunit... 2020-07-06T13:21:01.825 INFO:tasks.workunit:Pulling workunits from ref 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:21:01.826 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-07-06T13:21:01.827 INFO:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.1 2020-07-06T13:21:01.834 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.1 2020-07-06T13:21:01.834 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-07-06T13:21:01.835 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 32h/50d Inode: 1 Links: 2 2020-07-06T13:21:01.835 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-06T13:21:01.835 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2020-07-06 13:19:45.964688309 +0000 2020-07-06T13:21:01.836 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2020-07-06 13:19:45.964688309 +0000 2020-07-06T13:21:01.836 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2020-07-06 13:19:53.939079751 +0000 2020-07-06T13:21:01.836 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2020-07-06T13:21:01.836 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2020-07-06T13:21:01.837 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2020-07-06T13:21:01.908 INFO:tasks.workunit:timeout=3h 2020-07-06T13:21:01.908 INFO:tasks.workunit:cleanup=False 2020-07-06T13:21:01.909 INFO:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 754758768dacbb43223ce6879371b1e2ab6a4c92 2020-07-06T13:21:01.958 INFO:tasks.workunit.client.1.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2020-07-06T13:21:35.739 INFO:tasks.workunit.client.1.smithi148.stderr:Note: checking out '754758768dacbb43223ce6879371b1e2ab6a4c92'. 2020-07-06T13:21:35.739 INFO:tasks.workunit.client.1.smithi148.stderr: 2020-07-06T13:21:35.739 INFO:tasks.workunit.client.1.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-07-06T13:21:35.740 INFO:tasks.workunit.client.1.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2020-07-06T13:21:35.740 INFO:tasks.workunit.client.1.smithi148.stderr:state without impacting any branches by performing another checkout. 2020-07-06T13:21:35.740 INFO:tasks.workunit.client.1.smithi148.stderr: 2020-07-06T13:21:35.740 INFO:tasks.workunit.client.1.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2020-07-06T13:21:35.740 INFO:tasks.workunit.client.1.smithi148.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-07-06T13:21:35.741 INFO:tasks.workunit.client.1.smithi148.stderr: 2020-07-06T13:21:35.741 INFO:tasks.workunit.client.1.smithi148.stderr: git checkout -b 2020-07-06T13:21:35.741 INFO:tasks.workunit.client.1.smithi148.stderr: 2020-07-06T13:21:35.741 INFO:tasks.workunit.client.1.smithi148.stderr:HEAD is now at 754758768d Merge pull request #35885 from rhcs-dashboard/wip-46313-octopus 2020-07-06T13:21:35.743 INFO:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2020-07-06T13:21:35.793 INFO:tasks.workunit.client.1.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-07-06T13:21:35.796 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2020-07-06T13:21:35.796 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-07-06T13:21:35.866 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-07-06T13:21:35.927 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-07-06T13:21:35.984 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2020-07-06T13:21:35.986 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2020-07-06T13:21:35.986 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-07-06T13:21:36.039 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2020-07-06T13:21:36.098 DEBUG:teuthology.orchestra.remote:smithi148:/home/ubuntu/cephtest/workunits.list.client.1 is 4KB 2020-07-06T13:21:36.125 INFO:tasks.workunit:Running workunits matching fs/upgrade/volume_client on client.1... 2020-07-06T13:21:36.125 INFO:tasks.workunit:Running workunit fs/upgrade/volume_client... 2020-07-06T13:21:36.125 INFO:teuthology.orchestra.run.smithi148:workunit test fs/upgrade/volume_client> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=754758768dacbb43223ce6879371b1e2ab6a4c92 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 ACTION=populate adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/upgrade/volume_client 2020-07-06T13:21:36.157 INFO:tasks.workunit.client.1.smithi148.stderr:+ PYTHON=python2 2020-07-06T13:21:36.158 INFO:tasks.workunit.client.1.smithi148.stderr:+ main populate 2020-07-06T13:21:36.158 INFO:tasks.workunit.client.1.smithi148.stderr:+ '[' populate = create ']' 2020-07-06T13:21:36.159 INFO:tasks.workunit.client.1.smithi148.stderr:+ '[' populate = populate ']' 2020-07-06T13:21:36.159 INFO:tasks.workunit.client.1.smithi148.stderr:+ populate 2020-07-06T13:21:36.159 INFO:tasks.workunit.client.1.smithi148.stderr:+ pwd 2020-07-06T13:21:36.159 INFO:tasks.workunit.client.1.smithi148.stderr:+ df -h . 2020-07-06T13:21:36.159 INFO:tasks.workunit.client.1.smithi148.stdout:/home/ubuntu/cephtest/mnt.1/client.1/tmp 2020-07-06T13:21:36.163 INFO:tasks.workunit.client.1.smithi148.stdout:Filesystem Size Used Avail Use% Mounted on 2020-07-06T13:21:36.163 INFO:tasks.workunit.client.1.smithi148.stdout:ceph-fuse 8.0G 0 8.0G 0% /home/ubuntu/cephtest/mnt.1 2020-07-06T13:21:36.163 INFO:tasks.workunit.client.1.smithi148.stderr:+ ls -l 2020-07-06T13:21:36.166 INFO:tasks.workunit.client.1.smithi148.stdout:total 0 2020-07-06T13:21:36.166 INFO:tasks.workunit.client.1.smithi148.stderr:+ cp -a /usr/bin . 2020-07-06T13:22:01.247 INFO:tasks.workunit:Stopping ['fs/upgrade/volume_client'] on client.1... 2020-07-06T13:22:01.248 INFO:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2020-07-06T13:22:01.494 DEBUG:teuthology.parallel:result is None 2020-07-06T13:22:01.494 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:22:01.505 INFO:teuthology.task.print:**** fs/volume_client populate 2020-07-06T13:22:01.505 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2020-07-06T13:22:01.521 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:22:01.605 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:01.611 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.608 7fea923e7700 1 Processor -- start 2020-07-06T13:22:01.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.608 7fea923e7700 1 -- - start start 2020-07-06T13:22:01.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c14ba80 con 0 2020-07-06T13:22:01.612 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c14be20 con 0 2020-07-06T13:22:01.613 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8bfff700 1 -- 172.21.15.118:0/1973706346 learned_addr learned my addr 172.21.15.118:0/1973706346 2020-07-06T13:22:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea7c0039b0 con 0x7fea8c148040 2020-07-06T13:22:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2801966036 0 0) 0x7fea7c003d30 con 0x7fea8c148040 2020-07-06T13:22:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea78002a20 con 0 2020-07-06T13:22:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea800022a0 con 0x7fea8c14b340 2020-07-06T13:22:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1048558957 0 0) 0x7fea80002620 con 0x7fea8c14b340 2020-07-06T13:22:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea780046c0 con 0 2020-07-06T13:22:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3130265667 0 0) 0x7fea7c004300 con 0x7fea8c148040 2020-07-06T13:22:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 >> 172.21.15.118:6791/0 conn(0x7fea8c14b340 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-07-06T13:22:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c07a7e0 con 0 2020-07-06T13:22:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fea8c0e9f60 con 0x7fea8c148040 2020-07-06T13:22:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea8affd700 1 -- 172.21.15.118:0/1973706346 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea7c0013d0 con 0x7fea8c148040 2020-07-06T13:22:01.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- 172.21.15.118:0/1973706346 >> 172.21.15.118:6789/0 conn(0x7fea8c148040 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-07-06T13:22:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- 172.21.15.118:0/1973706346 shutdown_connections 2020-07-06T13:22:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- 172.21.15.118:0/1973706346 shutdown_connections 2020-07-06T13:22:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- 172.21.15.118:0/1973706346 wait complete. 2020-07-06T13:22:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.612 7fea923e7700 1 -- 172.21.15.118:0/1973706346 >> 172.21.15.118:0/1973706346 conn(0x7fea8c143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea923e7700 1 Processor -- start 2020-07-06T13:22:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea923e7700 1 -- - start start 2020-07-06T13:22:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea923e7700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c0a3b60 con 0 2020-07-06T13:22:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea923e7700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c0a6930 con 0 2020-07-06T13:22:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea8b7fe700 1 -- 172.21.15.118:0/3211160055 learned_addr learned my addr 172.21.15.118:0/3211160055 2020-07-06T13:22:01.622 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea800022a0 con 0x7fea8c0a6180 2020-07-06T13:22:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1264170491 0 0) 0x7fea800029b0 con 0x7fea8c0a6180 2020-07-06T13:22:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea6c002960 con 0 2020-07-06T13:22:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea7c0011d0 con 0x7fea8c0a31a0 2020-07-06T13:22:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4085153866 0 0) 0x7fea7c0018f0 con 0x7fea8c0a31a0 2020-07-06T13:22:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea6c004620 con 0 2020-07-06T13:22:01.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3625910423 0 0) 0x7fea80000e50 con 0x7fea8c0a6180 2020-07-06T13:22:01.624 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea6c002ee0 con 0 2020-07-06T13:22:01.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3000659911 0 0) 0x7fea7c001c70 con 0x7fea8c0a31a0 2020-07-06T13:22:01.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.616 7fea897fa700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea6c003540 con 0 2020-07-06T13:22:01.630 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (642095912 0 0) 0x7fea80001570 con 0x7fea8c0a6180 2020-07-06T13:22:01.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 >> 172.21.15.118:6790/0 conn(0x7fea8c0a31a0 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-07-06T13:22:01.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c07aa40 con 0 2020-07-06T13:22:01.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea923e7700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c0b2540 con 0 2020-07-06T13:22:01.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea923e7700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c18b0e0 con 0 2020-07-06T13:22:01.631 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fea8c116df0 con 0x7fea8c0a6180 2020-07-06T13:22:01.632 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fea800019a0 con 0x7fea8c0a6180 2020-07-06T13:22:01.632 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fea800044b0 con 0x7fea8c0a6180 2020-07-06T13:22:01.632 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.620 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fea80005e70 con 0x7fea8c0a6180 2020-07-06T13:22:01.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.624 7fea923e7700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea68002050 con 0 2020-07-06T13:22:01.633 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.628 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fea80003f90 con 0x7fea8c0a6180 2020-07-06T13:22:01.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.720 7fea923e7700 1 -- 172.21.15.118:0/3211160055 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea68001200 con 0 2020-07-06T13:22:01.724 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.720 7fea897fa700 1 -- 172.21.15.118:0/3211160055 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+7457 (675718476 0 1658814372) 0x7fea80006110 con 0x7fea8c0a6180 2020-07-06T13:22:01.724 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:01.724 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":26,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:19:47.406225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"fsvolume_vol_isolated","create_time":"2020-07-06 13:19:39.526679","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":3997,"pg_placement_num":3997,"last_change":"19","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:22:01.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 >> 172.21.15.118:6800/9723 conn(0x7fea6c006e70 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-07-06T13:22:01.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 >> 172.21.15.118:6791/0 conn(0x7fea8c0a6180 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-07-06T13:22:01.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 shutdown_connections 2020-07-06T13:22:01.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 shutdown_connections 2020-07-06T13:22:01.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 wait complete. 2020-07-06T13:22:01.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.724 7fea923e7700 1 -- 172.21.15.118:0/3211160055 >> 172.21.15.118:0/3211160055 conn(0x7fea8c099280 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:01.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-07-06 13:18:53.800616', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-06 13:18:56.457152', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2020-07-06 13:18:56.782594', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 8, 'pg_placement_num': 8, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'fsvolume_vol_isolated', 'create_time': '2020-07-06 13:19:39.526679', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_num': 3997, 'pg_placement_num': 3997, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-06T13:22:01.736 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-06T13:22:01.826 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:01.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.832 7fc83d279700 1 Processor -- start 2020-07-06T13:22:01.835 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.832 7fc83d279700 1 -- - start start 2020-07-06T13:22:01.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.832 7fc83d279700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83814ba70 con 0 2020-07-06T13:22:01.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.832 7fc83d279700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83814be10 con 0 2020-07-06T13:22:01.837 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.832 7fc837269700 1 -- 172.21.15.118:0/674006918 learned_addr learned my addr 172.21.15.118:0/674006918 2020-07-06T13:22:01.838 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc828003630 con 0x7fc838148030 2020-07-06T13:22:01.838 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc82c0022a0 con 0x7fc83814b330 2020-07-06T13:22:01.838 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (335469005 0 0) 0x7fc8280039b0 con 0x7fc838148030 2020-07-06T13:22:01.838 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc824002f40 con 0 2020-07-06T13:22:01.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (939824821 0 0) 0x7fc82c002620 con 0x7fc83814b330 2020-07-06T13:22:01.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc824004750 con 0 2020-07-06T13:22:01.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (992122474 0 0) 0x7fc828003ea0 con 0x7fc838148030 2020-07-06T13:22:01.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 >> 172.21.15.118:6789/0 conn(0x7fc83814b330 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-07-06T13:22:01.839 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83807a900 con 0 2020-07-06T13:22:01.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc8380e9f50 con 0x7fc838148030 2020-07-06T13:22:01.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- 172.21.15.118:0/674006918 >> 172.21.15.118:6790/0 conn(0x7fc838148030 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-07-06T13:22:01.840 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc836267700 1 -- 172.21.15.118:0/674006918 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc828001010 con 0x7fc838148030 2020-07-06T13:22:01.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- 172.21.15.118:0/674006918 shutdown_connections 2020-07-06T13:22:01.842 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- 172.21.15.118:0/674006918 shutdown_connections 2020-07-06T13:22:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- 172.21.15.118:0/674006918 wait complete. 2020-07-06T13:22:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- 172.21.15.118:0/674006918 >> 172.21.15.118:0/674006918 conn(0x7fc838143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 Processor -- start 2020-07-06T13:22:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.836 7fc83d279700 1 -- - start start 2020-07-06T13:22:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc83d279700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380a3ce0 con 0 2020-07-06T13:22:01.844 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc83d279700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380a6ab0 con 0 2020-07-06T13:22:01.844 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc836a68700 1 -- 172.21.15.118:0/3509022643 learned_addr learned my addr 172.21.15.118:0/3509022643 2020-07-06T13:22:01.844 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc828000e50 con 0x7fc8380a32f0 2020-07-06T13:22:01.844 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3881846027 0 0) 0x7fc8280033e0 con 0x7fc8380a32f0 2020-07-06T13:22:01.845 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc8180029c0 con 0 2020-07-06T13:22:01.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc82c002080 con 0x7fc8380a6300 2020-07-06T13:22:01.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2287850567 0 0) 0x7fc82c002380 con 0x7fc8380a6300 2020-07-06T13:22:01.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc818004680 con 0 2020-07-06T13:22:01.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3012863124 0 0) 0x7fc828003830 con 0x7fc8380a32f0 2020-07-06T13:22:01.846 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc818002f40 con 0 2020-07-06T13:22:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4258196281 0 0) 0x7fc82c000e50 con 0x7fc8380a6300 2020-07-06T13:22:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8180035a0 con 0 2020-07-06T13:22:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1700590126 0 0) 0x7fc82c001360 con 0x7fc8380a6300 2020-07-06T13:22:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 >> 172.21.15.118:6791/0 conn(0x7fc8380a32f0 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-07-06T13:22:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83807ab60 con 0 2020-07-06T13:22:01.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc83d279700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380712b0 con 0 2020-07-06T13:22:01.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc83d279700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83818b100 con 0 2020-07-06T13:22:01.848 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc82c000bf0 con 0x7fc8380a6300 2020-07-06T13:22:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fc82c001790 con 0x7fc8380a6300 2020-07-06T13:22:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fc82c0019d0 con 0x7fc8380a6300 2020-07-06T13:22:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.840 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fc82c005c30 con 0x7fc8380a6300 2020-07-06T13:22:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.848 7fc83d279700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83807af00 con 0 2020-07-06T13:22:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.852 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fc83807af00 con 0x7fc8380a6300 2020-07-06T13:22:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 --> 172.21.15.118:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc838156330 con 0 2020-07-06T13:22:01.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc834a64700 1 -- 172.21.15.118:0/3509022643 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v26) v1 ==== 92+0+10 (964071824 0 265718887) 0x7fc82c004b70 con 0x7fc8380a6300 2020-07-06T13:22:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:22:01.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 >> 172.21.15.118:6800/9723 conn(0x7fc818006e70 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-07-06T13:22:01.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 >> 172.21.15.118:6789/0 conn(0x7fc8380a6300 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-07-06T13:22:01.952 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 shutdown_connections 2020-07-06T13:22:01.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 shutdown_connections 2020-07-06T13:22:01.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 wait complete. 2020-07-06T13:22:01.953 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:01.948 7fc83d279700 1 -- 172.21.15.118:0/3509022643 >> 172.21.15.118:0/3509022643 conn(0x7fc8380994d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:01.961 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-06T13:22:02.051 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b3a184700 1 Processor -- start 2020-07-06T13:22:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b3a184700 1 -- - start start 2020-07-06T13:22:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b3a184700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3414ba80 con 0 2020-07-06T13:22:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b3a184700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3414be20 con 0 2020-07-06T13:22:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b337fe700 1 -- 172.21.15.118:0/3024390740 learned_addr learned my addr 172.21.15.118:0/3024390740 2020-07-06T13:22:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b240022a0 con 0x7f8b34148040 2020-07-06T13:22:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b1c0039b0 con 0x7f8b3414b340 2020-07-06T13:22:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (419396166 0 0) 0x7f8b24002620 con 0x7f8b34148040 2020-07-06T13:22:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8b14002ea0 con 0 2020-07-06T13:22:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (387411432 0 0) 0x7f8b1c003cb0 con 0x7f8b3414b340 2020-07-06T13:22:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8b140046b0 con 0 2020-07-06T13:22:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3156006689 0 0) 0x7f8b24002b10 con 0x7f8b34148040 2020-07-06T13:22:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 >> 172.21.15.118:6790/0 conn(0x7f8b3414b340 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-07-06T13:22:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3407a910 con 0 2020-07-06T13:22:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8b340e9f60 con 0x7f8b34148040 2020-07-06T13:22:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b32ffd700 1 -- 172.21.15.118:0/3024390740 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b24001010 con 0x7f8b34148040 2020-07-06T13:22:02.063 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.056 7f8b3a184700 1 -- 172.21.15.118:0/3024390740 >> 172.21.15.118:6789/0 conn(0x7f8b34148040 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-07-06T13:22:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- 172.21.15.118:0/3024390740 shutdown_connections 2020-07-06T13:22:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- 172.21.15.118:0/3024390740 shutdown_connections 2020-07-06T13:22:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- 172.21.15.118:0/3024390740 wait complete. 2020-07-06T13:22:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- 172.21.15.118:0/3024390740 >> 172.21.15.118:0/3024390740 conn(0x7f8b34143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 Processor -- start 2020-07-06T13:22:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- - start start 2020-07-06T13:22:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b340a3da0 con 0 2020-07-06T13:22:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b34095e10 con 0 2020-07-06T13:22:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b33fff700 1 -- 172.21.15.118:0/2640795909 learned_addr learned my addr 172.21.15.118:0/2640795909 2020-07-06T13:22:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b1c0037f0 con 0x7f8b340a5160 2020-07-06T13:22:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (332181961 0 0) 0x7f8b1c004030 con 0x7f8b340a5160 2020-07-06T13:22:02.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8b18002960 con 0 2020-07-06T13:22:02.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b24001010 con 0x7f8b340a33b0 2020-07-06T13:22:02.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4276454977 0 0) 0x7f8b24002050 con 0x7f8b340a33b0 2020-07-06T13:22:02.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8b18004620 con 0 2020-07-06T13:22:02.068 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2586194379 0 0) 0x7f8b1c0011d0 con 0x7f8b340a5160 2020-07-06T13:22:02.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b18002ee0 con 0 2020-07-06T13:22:02.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3278335845 0 0) 0x7f8b240024f0 con 0x7f8b340a33b0 2020-07-06T13:22:02.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b18003540 con 0 2020-07-06T13:22:02.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (736455879 0 0) 0x7f8b240017d0 con 0x7f8b340a33b0 2020-07-06T13:22:02.069 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 >> 172.21.15.118:6789/0 conn(0x7f8b340a5160 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-07-06T13:22:02.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3407ab70 con 0 2020-07-06T13:22:02.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.060 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34072bb0 con 0 2020-07-06T13:22:02.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.064 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b340a6ba0 con 0 2020-07-06T13:22:02.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.064 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8b24000bf0 con 0x7f8b340a33b0 2020-07-06T13:22:02.070 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.064 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8b24001c00 con 0x7f8b340a33b0 2020-07-06T13:22:02.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.064 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f8b24003490 con 0x7f8b340a33b0 2020-07-06T13:22:02.071 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.064 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f8b24003ae0 con 0x7f8b340a33b0 2020-07-06T13:22:02.073 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.072 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3407af10 con 0 2020-07-06T13:22:02.079 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.076 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8b3407af10 con 0x7f8b340a33b0 2020-07-06T13:22:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f8b3418bab0 con 0 2020-07-06T13:22:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b317fa700 1 -- 172.21.15.118:0/2640795909 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v26) v1 ==== 104+0+10 (2391828516 0 265718887) 0x7f8b24002f70 con 0x7f8b340a33b0 2020-07-06T13:22:02.175 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:22:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 >> 172.21.15.118:6800/9723 conn(0x7f8b18006e70 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-07-06T13:22:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 >> 172.21.15.118:6791/0 conn(0x7f8b340a33b0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-07-06T13:22:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 shutdown_connections 2020-07-06T13:22:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 shutdown_connections 2020-07-06T13:22:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 wait complete. 2020-07-06T13:22:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.172 7f8b3a184700 1 -- 172.21.15.118:0/2640795909 >> 172.21.15.118:0/2640795909 conn(0x7f8b340994e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.186 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-06T13:22:02.274 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:02.285 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 Processor -- start 2020-07-06T13:22:02.285 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 -- - start start 2020-07-06T13:22:02.286 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76814ba80 con 0 2020-07-06T13:22:02.286 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76814be20 con 0 2020-07-06T13:22:02.286 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76ca9c700 1 -- 172.21.15.118:0/1281209122 learned_addr learned my addr 172.21.15.118:0/1281209122 2020-07-06T13:22:02.288 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd7640022a0 con 0x7fd768148040 2020-07-06T13:22:02.288 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3739386162 0 0) 0x7fd764002620 con 0x7fd768148040 2020-07-06T13:22:02.288 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd74c002a20 con 0 2020-07-06T13:22:02.288 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd758003630 con 0x7fd76814b340 2020-07-06T13:22:02.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3315513835 0 0) 0x7fd758003930 con 0x7fd76814b340 2020-07-06T13:22:02.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd74c0046c0 con 0 2020-07-06T13:22:02.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1394259935 0 0) 0x7fd764002bf0 con 0x7fd768148040 2020-07-06T13:22:02.289 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 >> 172.21.15.118:6791/0 conn(0x7fd76814b340 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-07-06T13:22:02.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76807a910 con 0 2020-07-06T13:22:02.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd7680e9f60 con 0x7fd768148040 2020-07-06T13:22:02.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd75ffff700 1 -- 172.21.15.118:0/1281209122 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd764001050 con 0x7fd768148040 2020-07-06T13:22:02.290 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 -- 172.21.15.118:0/1281209122 >> 172.21.15.118:6789/0 conn(0x7fd768148040 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-07-06T13:22:02.291 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.284 7fd76f277700 1 -- 172.21.15.118:0/1281209122 shutdown_connections 2020-07-06T13:22:02.291 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- 172.21.15.118:0/1281209122 shutdown_connections 2020-07-06T13:22:02.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- 172.21.15.118:0/1281209122 wait complete. 2020-07-06T13:22:02.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- 172.21.15.118:0/1281209122 >> 172.21.15.118:0/1281209122 conn(0x7fd768143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 Processor -- start 2020-07-06T13:22:02.292 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- - start start 2020-07-06T13:22:02.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7680a3eb0 con 0 2020-07-06T13:22:02.294 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76f277700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7680a53d0 con 0 2020-07-06T13:22:02.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.288 7fd76d29d700 1 -- 172.21.15.118:0/3447047233 learned_addr learned my addr 172.21.15.118:0/3447047233 2020-07-06T13:22:02.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd758003e70 con 0x7fd7680a34c0 2020-07-06T13:22:02.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd764001010 con 0x7fd768095d00 2020-07-06T13:22:02.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3631935085 0 0) 0x7fd758003470 con 0x7fd7680a34c0 2020-07-06T13:22:02.295 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd750002df0 con 0 2020-07-06T13:22:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2274634211 0 0) 0x7fd764002070 con 0x7fd768095d00 2020-07-06T13:22:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd750004620 con 0 2020-07-06T13:22:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (215346863 0 0) 0x7fd758003800 con 0x7fd7680a34c0 2020-07-06T13:22:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd750004df0 con 0 2020-07-06T13:22:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2020798836 0 0) 0x7fd764002460 con 0x7fd768095d00 2020-07-06T13:22:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7500034b0 con 0 2020-07-06T13:22:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3516557239 0 0) 0x7fd7580010f0 con 0x7fd7680a34c0 2020-07-06T13:22:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 >> 172.21.15.118:6789/0 conn(0x7fd768095d00 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-07-06T13:22:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76807ab70 con 0 2020-07-06T13:22:02.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd768116df0 con 0x7fd7680a34c0 2020-07-06T13:22:02.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd758001520 con 0x7fd7680a34c0 2020-07-06T13:22:02.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd76f277700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680712c0 con 0 2020-07-06T13:22:02.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd76f277700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680a6d00 con 0 2020-07-06T13:22:02.298 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fd758001a80 con 0x7fd7680a34c0 2020-07-06T13:22:02.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.292 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fd758004260 con 0x7fd7680a34c0 2020-07-06T13:22:02.299 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.296 7fd76f277700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76807af10 con 0 2020-07-06T13:22:02.302 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.300 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd76807af10 con 0x7fd7680a34c0 2020-07-06T13:22:02.398 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.396 7fd76f277700 1 -- 172.21.15.118:0/3447047233 --> 172.21.15.118:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd768073300 con 0 2020-07-06T13:22:02.399 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.396 7fd75e7fc700 1 -- 172.21.15.118:0/3447047233 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v26) v1 ==== 100+0+10 (2688139813 0 265718887) 0x7fd758004710 con 0x7fd7680a34c0 2020-07-06T13:22:02.399 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2020-07-06T13:22:02.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 >> 172.21.15.118:6800/9723 conn(0x7fd7500072a0 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-07-06T13:22:02.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 >> 172.21.15.118:6791/0 conn(0x7fd7680a34c0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-07-06T13:22:02.401 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 shutdown_connections 2020-07-06T13:22:02.402 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 shutdown_connections 2020-07-06T13:22:02.402 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 wait complete. 2020-07-06T13:22:02.402 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.400 7fd76f277700 1 -- 172.21.15.118:0/3447047233 >> 172.21.15.118:0/3447047233 conn(0x7fd768099640 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.410 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get fsvolume_vol_isolated pg_num 2020-07-06T13:22:02.486 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:02.503 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98baa49700 1 Processor -- start 2020-07-06T13:22:02.503 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98baa49700 1 -- - start start 2020-07-06T13:22:02.505 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98baa49700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b414ba70 con 0 2020-07-06T13:22:02.505 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98baa49700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b414be10 con 0 2020-07-06T13:22:02.506 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98b3fff700 1 -- 172.21.15.118:0/3195485738 learned_addr learned my addr 172.21.15.118:0/3195485738 2020-07-06T13:22:02.506 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.500 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a40022a0 con 0x7f98b4148030 2020-07-06T13:22:02.506 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1342668778 0 0) 0x7f98a4002620 con 0x7f98b4148030 2020-07-06T13:22:02.506 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f98a0002a20 con 0 2020-07-06T13:22:02.507 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a8003630 con 0x7f98b414b330 2020-07-06T13:22:02.507 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2640160041 0 0) 0x7f98a80039b0 con 0x7f98b414b330 2020-07-06T13:22:02.507 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f98a00046c0 con 0 2020-07-06T13:22:02.507 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3723357121 0 0) 0x7f98a4002bf0 con 0x7f98b4148030 2020-07-06T13:22:02.507 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 >> 172.21.15.118:6791/0 conn(0x7f98b414b330 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-07-06T13:22:02.508 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b407a900 con 0 2020-07-06T13:22:02.508 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f98b40e9f50 con 0x7f98b4148030 2020-07-06T13:22:02.508 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98b37fe700 1 -- 172.21.15.118:0/3195485738 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a4001050 con 0x7f98b4148030 2020-07-06T13:22:02.508 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- 172.21.15.118:0/3195485738 >> 172.21.15.118:6790/0 conn(0x7f98b4148030 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-07-06T13:22:02.511 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- 172.21.15.118:0/3195485738 shutdown_connections 2020-07-06T13:22:02.512 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- 172.21.15.118:0/3195485738 shutdown_connections 2020-07-06T13:22:02.512 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- 172.21.15.118:0/3195485738 wait complete. 2020-07-06T13:22:02.512 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- 172.21.15.118:0/3195485738 >> 172.21.15.118:0/3195485738 conn(0x7f98b4143f60 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.512 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 Processor -- start 2020-07-06T13:22:02.513 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- - start start 2020-07-06T13:22:02.513 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40a3d30 con 0 2020-07-06T13:22:02.513 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.504 7f98baa49700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40a6b00 con 0 2020-07-06T13:22:02.513 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b8a6f700 1 -- 172.21.15.118:0/2785380140 learned_addr learned my addr 172.21.15.118:0/2785380140 2020-07-06T13:22:02.513 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a8003ef0 con 0x7f98b40a6350 2020-07-06T13:22:02.514 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1764014981 0 0) 0x7f98a80034c0 con 0x7f98b40a6350 2020-07-06T13:22:02.514 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9894002960 con 0 2020-07-06T13:22:02.514 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a4001010 con 0x7f98b40a3340 2020-07-06T13:22:02.514 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (223871523 0 0) 0x7f98a4001ff0 con 0x7f98b40a3340 2020-07-06T13:22:02.515 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9894004620 con 0 2020-07-06T13:22:02.515 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2468953629 0 0) 0x7f98a8000e50 con 0x7f98b40a6350 2020-07-06T13:22:02.515 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9894002ee0 con 0 2020-07-06T13:22:02.515 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1577244852 0 0) 0x7f98a4002380 con 0x7f98b40a3340 2020-07-06T13:22:02.515 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9894003540 con 0 2020-07-06T13:22:02.516 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1235413089 0 0) 0x7f98a8001360 con 0x7f98b40a6350 2020-07-06T13:22:02.516 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 >> 172.21.15.118:6791/0 conn(0x7f98b40a3340 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-07-06T13:22:02.516 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b407ab60 con 0 2020-07-06T13:22:02.516 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98baa49700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40712b0 con 0 2020-07-06T13:22:02.517 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98baa49700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b418b140 con 0 2020-07-06T13:22:02.517 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f98b4116de0 con 0x7f98b40a6350 2020-07-06T13:22:02.517 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f98a8001790 con 0x7f98b40a6350 2020-07-06T13:22:02.517 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f98a80019d0 con 0x7f98b40a6350 2020-07-06T13:22:02.518 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.508 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f98a8005e60 con 0x7f98b40a6350 2020-07-06T13:22:02.518 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.516 7f98baa49700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890002050 con 0 2020-07-06T13:22:02.523 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.520 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f98a8004510 con 0x7f98b40a6350 2020-07-06T13:22:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.612 7f98baa49700 1 -- 172.21.15.118:0/2785380140 --> 172.21.15.118:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"} v 0) v1 -- 0x7f98900012a0 con 0 2020-07-06T13:22:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.612 7f98b1ffb700 1 -- 172.21.15.118:0/2785380140 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "fsvolume_vol_isolated"}]=0 v26) v1 ==== 110+0+13 (28688288 0 66981700) 0x7f98a80048d0 con 0x7f98b40a6350 2020-07-06T13:22:02.615 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 3997 2020-07-06T13:22:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 >> 172.21.15.118:6800/9723 conn(0x7f9894006ed0 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-07-06T13:22:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 >> 172.21.15.118:6790/0 conn(0x7f98b40a6350 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-07-06T13:22:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 shutdown_connections 2020-07-06T13:22:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 shutdown_connections 2020-07-06T13:22:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 wait complete. 2020-07-06T13:22:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.616 7f98baa49700 1 -- 172.21.15.118:0/2785380140 >> 172.21.15.118:0/2785380140 conn(0x7f98b4099580 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.626 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:02.712 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.716 7f2f3a77a700 1 Processor -- start 2020-07-06T13:22:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.716 7f2f3a77a700 1 -- - start start 2020-07-06T13:22:02.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.716 7f2f3a77a700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3414ba90 con 0 2020-07-06T13:22:02.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.716 7f2f3a77a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3414be30 con 0 2020-07-06T13:22:02.720 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.716 7f2f33fff700 1 -- 172.21.15.118:0/2764234718 learned_addr learned my addr 172.21.15.118:0/2764234718 2020-07-06T13:22:02.721 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f1c0022a0 con 0x7f2f3414b350 2020-07-06T13:22:02.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f24003630 con 0x7f2f34148050 2020-07-06T13:22:02.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4212008700 0 0) 0x7f2f1c002620 con 0x7f2f3414b350 2020-07-06T13:22:02.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f14002ea0 con 0 2020-07-06T13:22:02.722 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (583842772 0 0) 0x7f2f240039b0 con 0x7f2f34148050 2020-07-06T13:22:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f140046b0 con 0 2020-07-06T13:22:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1392188954 0 0) 0x7f2f1c002b10 con 0x7f2f3414b350 2020-07-06T13:22:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 >> 172.21.15.118:6789/0 conn(0x7f2f34148050 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-07-06T13:22:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3407a7f0 con 0 2020-07-06T13:22:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2f34116e00 con 0x7f2f3414b350 2020-07-06T13:22:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f337fe700 1 -- 172.21.15.118:0/2764234718 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f1c001010 con 0x7f2f3414b350 2020-07-06T13:22:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f3a77a700 1 -- 172.21.15.118:0/2764234718 >> 172.21.15.118:6790/0 conn(0x7f2f3414b350 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-07-06T13:22:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f3a77a700 1 -- 172.21.15.118:0/2764234718 shutdown_connections 2020-07-06T13:22:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f3a77a700 1 -- 172.21.15.118:0/2764234718 shutdown_connections 2020-07-06T13:22:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f3a77a700 1 -- 172.21.15.118:0/2764234718 wait complete. 2020-07-06T13:22:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.720 7f2f3a77a700 1 -- 172.21.15.118:0/2764234718 >> 172.21.15.118:0/2764234718 conn(0x7f2f34143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 Processor -- start 2020-07-06T13:22:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 -- - start start 2020-07-06T13:22:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340a3c10 con 0 2020-07-06T13:22:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340a67f0 con 0 2020-07-06T13:22:02.727 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f33fff700 1 -- 172.21.15.118:0/3584933877 learned_addr learned my addr 172.21.15.118:0/3584933877 2020-07-06T13:22:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f24003fe0 con 0x7f2f340a3220 2020-07-06T13:22:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2446215834 0 0) 0x7f2f240034d0 con 0x7f2f340a3220 2020-07-06T13:22:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f18002960 con 0 2020-07-06T13:22:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f1c000e50 con 0x7f2f340a61a0 2020-07-06T13:22:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2101377742 0 0) 0x7f2f1c002050 con 0x7f2f340a61a0 2020-07-06T13:22:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f18004620 con 0 2020-07-06T13:22:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (802701003 0 0) 0x7f2f24000e50 con 0x7f2f340a3220 2020-07-06T13:22:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f18002ee0 con 0 2020-07-06T13:22:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4261806983 0 0) 0x7f2f1c0023d0 con 0x7f2f340a61a0 2020-07-06T13:22:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f18003540 con 0 2020-07-06T13:22:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3666757847 0 0) 0x7f2f240013c0 con 0x7f2f340a3220 2020-07-06T13:22:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 >> 172.21.15.118:6791/0 conn(0x7f2f340a61a0 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-07-06T13:22:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3407aa50 con 0 2020-07-06T13:22:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f340b2650 con 0 2020-07-06T13:22:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3418b0f0 con 0 2020-07-06T13:22:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2f24000bf0 con 0x7f2f340a3220 2020-07-06T13:22:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f240017f0 con 0x7f2f340a3220 2020-07-06T13:22:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f2f24001a30 con 0x7f2f340a3220 2020-07-06T13:22:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.724 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f2f24004260 con 0x7f2f340a3220 2020-07-06T13:22:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.728 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3407add0 con 0 2020-07-06T13:22:02.736 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.732 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2f3407add0 con 0x7f2f340a3220 2020-07-06T13:22:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f340730f0 con 0 2020-07-06T13:22:02.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f31ffb700 1 -- 172.21.15.118:0/3584933877 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2251 (4058427516 0 3147250658) 0x7f2f24004ad0 con 0x7f2f340a3220 2020-07-06T13:22:02.830 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2020-07-06T13:22:02.830 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:02.830 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:19:40.336529","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:02.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 >> 172.21.15.118:6800/9723 conn(0x7f2f18006e70 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-07-06T13:22:02.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 >> 172.21.15.118:6790/0 conn(0x7f2f340a3220 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-07-06T13:22:02.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 shutdown_connections 2020-07-06T13:22:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 shutdown_connections 2020-07-06T13:22:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 wait complete. 2020-07-06T13:22:02.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.828 7f2f3a77a700 1 -- 172.21.15.118:0/3584933877 >> 172.21.15.118:0/3584933877 conn(0x7f2f340993a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.846 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-06T13:22:02.931 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:02.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f97739700 1 Processor -- start 2020-07-06T13:22:02.938 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f97739700 1 -- - start start 2020-07-06T13:22:02.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f97739700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9014ba90 con 0 2020-07-06T13:22:02.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f97739700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9014be30 con 0 2020-07-06T13:22:02.939 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f9575f700 1 -- 172.21.15.118:0/4177773383 learned_addr learned my addr 172.21.15.118:0/4177773383 2020-07-06T13:22:02.940 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f8c003630 con 0x7f2f90148050 2020-07-06T13:22:02.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1299429818 0 0) 0x7f2f8c0039b0 con 0x7f2f90148050 2020-07-06T13:22:02.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f74002a20 con 0 2020-07-06T13:22:02.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f800022a0 con 0x7f2f9014b350 2020-07-06T13:22:02.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1171036498 0 0) 0x7f2f80002620 con 0x7f2f9014b350 2020-07-06T13:22:02.941 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f740046c0 con 0 2020-07-06T13:22:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (37013796 0 0) 0x7f2f8c003f80 con 0x7f2f90148050 2020-07-06T13:22:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 >> 172.21.15.118:6791/0 conn(0x7f2f9014b350 :-1 s=STATE_OPEN pgs=117 cs=1 l=1).mark_down 2020-07-06T13:22:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9007a7f0 con 0 2020-07-06T13:22:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2f900e9f70 con 0x7f2f90148050 2020-07-06T13:22:02.942 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.936 7f2f97739700 1 -- 172.21.15.118:0/4177773383 >> 172.21.15.118:6789/0 conn(0x7f2f90148050 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-07-06T13:22:02.943 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f87fff700 1 -- 172.21.15.118:0/4177773383 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f8c001050 con 0x7f2f90148050 2020-07-06T13:22:02.945 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- 172.21.15.118:0/4177773383 shutdown_connections 2020-07-06T13:22:02.945 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- 172.21.15.118:0/4177773383 shutdown_connections 2020-07-06T13:22:02.945 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- 172.21.15.118:0/4177773383 wait complete. 2020-07-06T13:22:02.945 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- 172.21.15.118:0/4177773383 >> 172.21.15.118:0/4177773383 conn(0x7f2f90143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:02.945 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 Processor -- start 2020-07-06T13:22:02.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- - start start 2020-07-06T13:22:02.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900a3b70 con 0 2020-07-06T13:22:02.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f97739700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900a6940 con 0 2020-07-06T13:22:02.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f94f5e700 1 -- 172.21.15.118:0/1831230142 learned_addr learned my addr 172.21.15.118:0/1831230142 2020-07-06T13:22:02.946 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f800022a0 con 0x7f2f900a6190 2020-07-06T13:22:02.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2155999095 0 0) 0x7f2f800029b0 con 0x7f2f900a6190 2020-07-06T13:22:02.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f78002960 con 0 2020-07-06T13:22:02.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f8c000e50 con 0x7f2f900a31b0 2020-07-06T13:22:02.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3226459504 0 0) 0x7f2f8c001570 con 0x7f2f900a31b0 2020-07-06T13:22:02.947 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2f78004620 con 0 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1972390255 0 0) 0x7f2f8c0018f0 con 0x7f2f900a31b0 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.940 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f78002ee0 con 0 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2676701453 0 0) 0x7f2f80000e50 con 0x7f2f900a6190 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f78003540 con 0 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4233718078 0 0) 0x7f2f8c003380 con 0x7f2f900a31b0 2020-07-06T13:22:02.948 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 >> 172.21.15.118:6791/0 conn(0x7f2f900a6190 :-1 s=STATE_OPEN pgs=118 cs=1 l=1).mark_down 2020-07-06T13:22:02.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9007aa50 con 0 2020-07-06T13:22:02.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f97739700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900b2550 con 0 2020-07-06T13:22:02.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2f8c000bf0 con 0x7f2f900a31b0 2020-07-06T13:22:02.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f2f8c0037b0 con 0x7f2f900a31b0 2020-07-06T13:22:02.949 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f97739700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9018b0f0 con 0 2020-07-06T13:22:02.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f2f8c004660 con 0x7f2f900a31b0 2020-07-06T13:22:02.950 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.944 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f2f8c006200 con 0x7f2f900a31b0 2020-07-06T13:22:02.951 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.948 7f2f97739700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9007add0 con 0 2020-07-06T13:22:02.955 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:02.952 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2f9007add0 con 0x7f2f900a31b0 2020-07-06T13:22:03.049 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f900730f0 con 0 2020-07-06T13:22:03.049 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f867fc700 1 -- 172.21.15.118:0/1831230142 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+7457 (675718476 0 1658814372) 0x7f2f8c0049e0 con 0x7f2f900a31b0 2020-07-06T13:22:03.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:03.050 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":26,"fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","created":"2020-07-06 13:18:44.393031","modified":"2020-07-06 13:19:47.406225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-07-06 13:18:53.800616","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-07-06 13:18:56.457152","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-07-06 13:18:56.782594","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"fsvolume_vol_isolated","create_time":"2020-07-06 13:19:39.526679","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":3997,"pg_placement_num":3997,"last_change":"19","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6be8af8-e07a-4192-8f17-7763c852c626","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6809/10099","cluster_addr":"172.21.15.118:6810/10099","heartbeat_back_addr":"172.21.15.118:6811/10099","heartbeat_front_addr":"172.21.15.118:6812/10099","state":["exists","up"]},{"osd":1,"uuid":"d6455359-2116-4bb1-acc1-91d5e15f9c18","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6801/10089","cluster_addr":"172.21.15.118:6802/10089","heartbeat_back_addr":"172.21.15.118:6803/10089","heartbeat_front_addr":"172.21.15.118:6804/10089","state":["exists","up"]},{"osd":2,"uuid":"8b609f5d-862e-4579-8c93-a2175c7ccc38","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6805/10088","cluster_addr":"172.21.15.118:6806/10088","heartbeat_back_addr":"172.21.15.118:6807/10088","heartbeat_front_addr":"172.21.15.118:6808/10088","state":["exists","up"]},{"osd":3,"uuid":"725283f8-d498-435b-b418-72041ff08ad1","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addr":"172.21.15.118:6813/10110","cluster_addr":"172.21.15.118:6814/10110","heartbeat_back_addr":"172.21.15.118:6815/10110","heartbeat_front_addr":"172.21.15.118:6816/10110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-07-06T13:22:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 >> 172.21.15.118:6800/9723 conn(0x7f2f78006ed0 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-07-06T13:22:03.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 >> 172.21.15.118:6790/0 conn(0x7f2f900a31b0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-07-06T13:22:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 shutdown_connections 2020-07-06T13:22:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 shutdown_connections 2020-07-06T13:22:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 wait complete. 2020-07-06T13:22:03.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.048 7f2f97739700 1 -- 172.21.15.118:0/1831230142 >> 172.21.15.118:0/1831230142 conn(0x7f2f90099290 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:03.060 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs max_mds 1 2020-07-06T13:22:03.147 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:03.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.152 7f8658027700 1 Processor -- start 2020-07-06T13:22:03.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.152 7f8658027700 1 -- - start start 2020-07-06T13:22:03.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865014ba80 con 0 2020-07-06T13:22:03.158 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865014be20 con 0 2020-07-06T13:22:03.158 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865604d700 1 -- 172.21.15.118:0/4115942845 learned_addr learned my addr 172.21.15.118:0/4115942845 2020-07-06T13:22:03.158 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f86400022a0 con 0x7f865014b340 2020-07-06T13:22:03.158 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (390806672 0 0) 0x7f8640002620 con 0x7f865014b340 2020-07-06T13:22:03.158 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8638002a20 con 0 2020-07-06T13:22:03.159 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f864c003630 con 0x7f8650148040 2020-07-06T13:22:03.159 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2890287851 0 0) 0x7f864c0039b0 con 0x7f8650148040 2020-07-06T13:22:03.159 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f86380046b0 con 0 2020-07-06T13:22:03.161 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4248052268 0 0) 0x7f8640002bf0 con 0x7f865014b340 2020-07-06T13:22:03.161 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 >> 172.21.15.118:6790/0 conn(0x7f8650148040 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-07-06T13:22:03.161 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865007a910 con 0 2020-07-06T13:22:03.161 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8640000bf0 con 0x7f865014b340 2020-07-06T13:22:03.162 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- 172.21.15.118:0/4115942845 >> 172.21.15.118:6789/0 conn(0x7f865014b340 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-07-06T13:22:03.162 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f865504b700 1 -- 172.21.15.118:0/4115942845 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8640001050 con 0x7f865014b340 2020-07-06T13:22:03.162 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- 172.21.15.118:0/4115942845 shutdown_connections 2020-07-06T13:22:03.162 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- 172.21.15.118:0/4115942845 shutdown_connections 2020-07-06T13:22:03.162 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- 172.21.15.118:0/4115942845 wait complete. 2020-07-06T13:22:03.163 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.156 7f8658027700 1 -- 172.21.15.118:0/4115942845 >> 172.21.15.118:0/4115942845 conn(0x7f8650143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:03.163 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 Processor -- start 2020-07-06T13:22:03.163 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 -- - start start 2020-07-06T13:22:03.163 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865009fbb0 con 0 2020-07-06T13:22:03.163 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500a2980 con 0 2020-07-06T13:22:03.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f865584c700 1 -- 172.21.15.118:0/3243012599 learned_addr learned my addr 172.21.15.118:0/3243012599 2020-07-06T13:22:03.165 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8640000e50 con 0x7f86500a21d0 2020-07-06T13:22:03.167 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f864c003ef0 con 0x7f865009f1c0 2020-07-06T13:22:03.167 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2561855801 0 0) 0x7f8640001ff0 con 0x7f86500a21d0 2020-07-06T13:22:03.168 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8630002df0 con 0 2020-07-06T13:22:03.168 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2990898743 0 0) 0x7f864c0034c0 con 0x7f865009f1c0 2020-07-06T13:22:03.168 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8630004620 con 0 2020-07-06T13:22:03.168 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2619784798 0 0) 0x7f864c003920 con 0x7f865009f1c0 2020-07-06T13:22:03.169 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8630004df0 con 0 2020-07-06T13:22:03.169 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4036407214 0 0) 0x7f86400023c0 con 0x7f86500a21d0 2020-07-06T13:22:03.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8630006570 con 0 2020-07-06T13:22:03.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2595326663 0 0) 0x7f8640001810 con 0x7f86500a21d0 2020-07-06T13:22:03.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 >> 172.21.15.118:6791/0 conn(0x7f865009f1c0 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=119 cs=1 l=1).mark_down 2020-07-06T13:22:03.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865007ab70 con 0 2020-07-06T13:22:03.170 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86500712f0 con 0 2020-07-06T13:22:03.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f8658027700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f865018b390 con 0 2020-07-06T13:22:03.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8650116df0 con 0x7f86500a21d0 2020-07-06T13:22:03.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f8640001a80 con 0x7f86500a21d0 2020-07-06T13:22:03.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f86400033c0 con 0x7f86500a21d0 2020-07-06T13:22:03.171 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.160 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f8640006060 con 0x7f86500a21d0 2020-07-06T13:22:03.172 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.168 7f8658027700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c002050 con 0 2020-07-06T13:22:03.177 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.176 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8640003a10 con 0x7f86500a21d0 2020-07-06T13:22:03.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.268 7f8658027700 1 -- 172.21.15.118:0/3243012599 --> 172.21.15.118:6790/0 -- mon_command({"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"} v 0) v1 -- 0x7f862c001280 con 0 2020-07-06T13:22:03.796 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.792 7f863f7fe700 1 -- 172.21.15.118:0/3243012599 <== mon.1 172.21.15.118:6790/0 10 ==== mon_command_ack([{"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"}]=0 v8) v1 ==== 105+0+0 (509145602 0 0) 0x7f8640002ea0 con 0x7f86500a21d0 2020-07-06T13:22:03.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 >> 172.21.15.118:6800/9723 conn(0x7f86300072a0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-07-06T13:22:03.803 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 >> 172.21.15.118:6790/0 conn(0x7f86500a21d0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-07-06T13:22:03.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 shutdown_connections 2020-07-06T13:22:03.804 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 shutdown_connections 2020-07-06T13:22:03.805 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 wait complete. 2020-07-06T13:22:03.805 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.800 7f8658027700 1 -- 172.21.15.118:0/3243012599 >> 172.21.15.118:0/3243012599 conn(0x7f8650177fa0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:03.818 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:03.905 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:03.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ec96700 1 Processor -- start 2020-07-06T13:22:03.914 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ec96700 1 -- - start start 2020-07-06T13:22:03.915 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ec96700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603814ba90 con 0 2020-07-06T13:22:03.915 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ec96700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603814be30 con 0 2020-07-06T13:22:03.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ccbc700 1 -- 172.21.15.118:0/2823327417 learned_addr learned my addr 172.21.15.118:0/2823327417 2020-07-06T13:22:03.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6028003630 con 0x7f6038148050 2020-07-06T13:22:03.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1107378416 0 0) 0x7f60280039b0 con 0x7f6038148050 2020-07-06T13:22:03.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6024002a20 con 0 2020-07-06T13:22:03.916 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f602c0022a0 con 0x7f603814b350 2020-07-06T13:22:03.917 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4125032602 0 0) 0x7f602c0025a0 con 0x7f603814b350 2020-07-06T13:22:03.917 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f60240046b0 con 0 2020-07-06T13:22:03.918 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2099044261 0 0) 0x7f6028003f80 con 0x7f6038148050 2020-07-06T13:22:03.918 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 >> 172.21.15.118:6789/0 conn(0x7f603814b350 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-07-06T13:22:03.918 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603807a7f0 con 0 2020-07-06T13:22:03.918 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f60380e9f70 con 0x7f6038148050 2020-07-06T13:22:03.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f60377fe700 1 -- 172.21.15.118:0/2823327417 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6028001050 con 0x7f6038148050 2020-07-06T13:22:03.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.912 7f603ec96700 1 -- 172.21.15.118:0/2823327417 >> 172.21.15.118:6791/0 conn(0x7f6038148050 :-1 s=STATE_OPEN pgs=120 cs=1 l=1).mark_down 2020-07-06T13:22:03.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 -- 172.21.15.118:0/2823327417 shutdown_connections 2020-07-06T13:22:03.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 -- 172.21.15.118:0/2823327417 shutdown_connections 2020-07-06T13:22:03.919 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 -- 172.21.15.118:0/2823327417 wait complete. 2020-07-06T13:22:03.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 -- 172.21.15.118:0/2823327417 >> 172.21.15.118:0/2823327417 conn(0x7f6038143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:03.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 Processor -- start 2020-07-06T13:22:03.920 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.916 7f603ec96700 1 -- - start start 2020-07-06T13:22:03.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f603ec96700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380a3c10 con 0 2020-07-06T13:22:03.921 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f603ec96700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380a69e0 con 0 2020-07-06T13:22:03.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f603ccbc700 1 -- 172.21.15.118:0/60779620 learned_addr learned my addr 172.21.15.118:0/60779620 2020-07-06T13:22:03.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f6028000e50 con 0x7f60380a3220 2020-07-06T13:22:03.922 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f602c002ae0 con 0x7f60380a6230 2020-07-06T13:22:03.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1552789512 0 0) 0x7f6028003380 con 0x7f60380a3220 2020-07-06T13:22:03.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6018002df0 con 0 2020-07-06T13:22:03.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3171886892 0 0) 0x7f602c0020e0 con 0x7f60380a6230 2020-07-06T13:22:03.923 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6018004620 con 0 2020-07-06T13:22:03.924 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1580815369 0 0) 0x7f602c002470 con 0x7f60380a6230 2020-07-06T13:22:03.924 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6018004df0 con 0 2020-07-06T13:22:03.925 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3016675271 0 0) 0x7f6028003750 con 0x7f60380a3220 2020-07-06T13:22:03.925 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6018006570 con 0 2020-07-06T13:22:03.925 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1352325953 0 0) 0x7f602c0010f0 con 0x7f60380a6230 2020-07-06T13:22:03.925 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 >> 172.21.15.118:6791/0 conn(0x7f60380a3220 :-1 s=STATE_OPEN pgs=121 cs=1 l=1).mark_down 2020-07-06T13:22:03.925 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603807aa50 con 0 2020-07-06T13:22:03.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f603ec96700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6038071130 con 0 2020-07-06T13:22:03.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f603ec96700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f603818b180 con 0 2020-07-06T13:22:03.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f602c000bf0 con 0x7f60380a6230 2020-07-06T13:22:03.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f602c001520 con 0x7f60380a6230 2020-07-06T13:22:03.926 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f602c001a40 con 0x7f60380a6230 2020-07-06T13:22:03.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.920 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f602c004c10 con 0x7f60380a6230 2020-07-06T13:22:03.929 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.928 7f603ec96700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603807add0 con 0 2020-07-06T13:22:03.933 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:03.932 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f603807add0 con 0x7f60380a6230 2020-07-06T13:22:04.026 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.024 7f603ec96700 1 -- 172.21.15.118:0/60779620 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60380730f0 con 0 2020-07-06T13:22:04.027 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.024 7f6035ffb700 1 -- 172.21.15.118:0/60779620 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2251 (581493562 0 907468826) 0x7f602c003570 con 0x7f60380a6230 2020-07-06T13:22:04.027 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2020-07-06T13:22:04.027 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:04.027 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:22:03.786063","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:04.028 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 >> 172.21.15.118:6800/9723 conn(0x7f60180072a0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-07-06T13:22:04.028 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 >> 172.21.15.118:6789/0 conn(0x7f60380a6230 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-07-06T13:22:04.029 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 shutdown_connections 2020-07-06T13:22:04.029 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 shutdown_connections 2020-07-06T13:22:04.029 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 wait complete. 2020-07-06T13:22:04.030 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.028 7f603ec96700 1 -- 172.21.15.118:0/60779620 >> 172.21.15.118:0/60779620 conn(0x7f60380995b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:04.038 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:04.122 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.124 7f7aa920a700 1 Processor -- start 2020-07-06T13:22:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.124 7f7aa920a700 1 -- - start start 2020-07-06T13:22:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.124 7f7aa920a700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa414ba90 con 0 2020-07-06T13:22:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.124 7f7aa920a700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa414be30 con 0 2020-07-06T13:22:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.124 7f7aa2826700 1 -- 172.21.15.118:0/630791713 learned_addr learned my addr 172.21.15.118:0/630791713 2020-07-06T13:22:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a8c0039b0 con 0x7f7aa414b350 2020-07-06T13:22:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2408141493 0 0) 0x7f7a8c003d30 con 0x7f7aa414b350 2020-07-06T13:22:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7a84002a20 con 0 2020-07-06T13:22:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a9c0022a0 con 0x7f7aa4148050 2020-07-06T13:22:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1660438781 0 0) 0x7f7a9c002620 con 0x7f7aa4148050 2020-07-06T13:22:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7a840046b0 con 0 2020-07-06T13:22:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3663941181 0 0) 0x7f7a9c002ac0 con 0x7f7aa4148050 2020-07-06T13:22:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 >> 172.21.15.118:6790/0 conn(0x7f7aa414b350 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-07-06T13:22:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa407a7f0 con 0 2020-07-06T13:22:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7a9c000bf0 con 0x7f7aa4148050 2020-07-06T13:22:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa920a700 1 -- 172.21.15.118:0/630791713 >> 172.21.15.118:6789/0 conn(0x7f7aa4148050 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-07-06T13:22:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa2025700 1 -- 172.21.15.118:0/630791713 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a9c001010 con 0x7f7aa4148050 2020-07-06T13:22:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa920a700 1 -- 172.21.15.118:0/630791713 shutdown_connections 2020-07-06T13:22:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa920a700 1 -- 172.21.15.118:0/630791713 shutdown_connections 2020-07-06T13:22:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa920a700 1 -- 172.21.15.118:0/630791713 wait complete. 2020-07-06T13:22:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.128 7f7aa920a700 1 -- 172.21.15.118:0/630791713 >> 172.21.15.118:0/630791713 conn(0x7f7aa4143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 Processor -- start 2020-07-06T13:22:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 -- - start start 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa409fa60 con 0 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40a2830 con 0 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa3027700 1 -- 172.21.15.118:0/3830502249 learned_addr learned my addr 172.21.15.118:0/3830502249 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a9c000e50 con 0x7f7aa409f070 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (575471505 0 0) 0x7f7a9c002080 con 0x7f7aa409f070 2020-07-06T13:22:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7a88002960 con 0 2020-07-06T13:22:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a8c0037c0 con 0x7f7aa40a2080 2020-07-06T13:22:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2179211287 0 0) 0x7f7a8c003a80 con 0x7f7aa40a2080 2020-07-06T13:22:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7a88004620 con 0 2020-07-06T13:22:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2823209200 0 0) 0x7f7a9c0024d0 con 0x7f7aa409f070 2020-07-06T13:22:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7a88002ee0 con 0 2020-07-06T13:22:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3489150223 0 0) 0x7f7a8c0011d0 con 0x7f7aa40a2080 2020-07-06T13:22:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7a88003540 con 0 2020-07-06T13:22:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2379585851 0 0) 0x7f7a9c0017d0 con 0x7f7aa409f070 2020-07-06T13:22:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 >> 172.21.15.118:6791/0 conn(0x7f7aa40a2080 :-1 s=STATE_OPEN pgs=122 cs=1 l=1).mark_down 2020-07-06T13:22:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa407aa50 con 0 2020-07-06T13:22:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa4071130 con 0 2020-07-06T13:22:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa418b360 con 0 2020-07-06T13:22:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7a9c001320 con 0x7f7aa409f070 2020-07-06T13:22:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f7a9c001c00 con 0x7f7aa409f070 2020-07-06T13:22:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f7a9c0033f0 con 0x7f7aa409f070 2020-07-06T13:22:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.132 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f7a9c003a40 con 0x7f7aa409f070 2020-07-06T13:22:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.140 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c002050 con 0 2020-07-06T13:22:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.144 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f7a9c0030e0 con 0x7f7aa409f070 2020-07-06T13:22:04.237 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a7c0011b0 con 0 2020-07-06T13:22:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa0822700 1 -- 172.21.15.118:0/3830502249 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2251 (581493562 0 907468826) 0x7f7a9c0058e0 con 0x7f7aa409f070 2020-07-06T13:22:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2020-07-06T13:22:04.238 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:04.238 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:22:03.786063","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:04.239 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 >> 172.21.15.118:6800/9723 conn(0x7f7a88006e70 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-07-06T13:22:04.239 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 >> 172.21.15.118:6789/0 conn(0x7f7aa409f070 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-07-06T13:22:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 shutdown_connections 2020-07-06T13:22:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 shutdown_connections 2020-07-06T13:22:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 wait complete. 2020-07-06T13:22:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:04.236 7f7aa920a700 1 -- 172.21.15.118:0/3830502249 >> 172.21.15.118:0/3830502249 conn(0x7f7aa4177f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:04.556 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-06 13:18:57.751069', 'modified': '2020-07-06 13:22:03.786063', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4211': {'gid': 4211, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.118:6819/1597074397', 'standby_for_rank': -1, 'standby_for_fscid': -1, 'standby_for_name': '', 'standby_replay': False, 'export_targets': [], 'features': 4611087854031667195}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-06T13:22:04.557 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-06T13:22:04.557 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-07-06T13:22:04.642 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"74e2240b-47f9-4a3f-ade9-f9f65278ae84","whoami":0,"id":4211,"want_state":"up:active","state":"up:active","rank_uptime":184.872612,"mdsmap_epoch":8,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":185.292732} 2020-07-06T13:22:04.648 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "74e2240b-47f9-4a3f-ade9-f9f65278ae84", "id": 4211, "mdsmap_epoch": 8, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 184.872612, "state": "up:active", "uptime": 185.292732, "want_state": "up:active", "whoami": 0 } 2020-07-06T13:22:04.649 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-07-06T13:22:04.649 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:22:04.662 INFO:tasks.ceph.mds.a:Stopped 2020-07-06T13:22:04.663 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-07-06T13:22:04.663 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:22:04.718 INFO:tasks.ceph.mds.c:Stopped 2020-07-06T13:22:09.720 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:09.818 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0710da1700 1 Processor -- start 2020-07-06T13:22:09.818 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0710da1700 1 -- - start start 2020-07-06T13:22:09.819 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0710da1700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c14ba80 con 0 2020-07-06T13:22:09.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0710da1700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c14be20 con 0 2020-07-06T13:22:09.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f070ad71700 1 -- 172.21.15.118:0/2662091366 learned_addr learned my addr 172.21.15.118:0/2662091366 2020-07-06T13:22:09.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f06f4002620 con 0x7f070c14b340 2020-07-06T13:22:09.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4040279057 0 0) 0x7f06f40029a0 con 0x7f070c14b340 2020-07-06T13:22:09.820 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06ec002a20 con 0 2020-07-06T13:22:09.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0704003630 con 0x7f070c148040 2020-07-06T13:22:09.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2583088625 0 0) 0x7f0704003930 con 0x7f070c148040 2020-07-06T13:22:09.821 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06ec0046b0 con 0 2020-07-06T13:22:09.822 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2014368790 0 0) 0x7f06f4002f70 con 0x7f070c14b340 2020-07-06T13:22:09.822 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 >> 172.21.15.118:6789/0 conn(0x7f070c148040 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=117 cs=1 l=1).mark_down 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.816 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 --> 172.21.15.118:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c07a7e0 con 0 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.1 172.21.15.118:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f070c116df0 con 0x7f070c14b340 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0709d6f700 1 -- 172.21.15.118:0/2662091366 <== mon.1 172.21.15.118:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f06f40013d0 con 0x7f070c14b340 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0710da1700 1 -- 172.21.15.118:0/2662091366 >> 172.21.15.118:6790/0 conn(0x7f070c14b340 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0710da1700 1 -- 172.21.15.118:0/2662091366 shutdown_connections 2020-07-06T13:22:09.823 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0710da1700 1 -- 172.21.15.118:0/2662091366 shutdown_connections 2020-07-06T13:22:09.824 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0710da1700 1 -- 172.21.15.118:0/2662091366 wait complete. 2020-07-06T13:22:09.824 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.820 7f0710da1700 1 -- 172.21.15.118:0/2662091366 >> 172.21.15.118:0/2662091366 conn(0x7f070c143f70 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:09.824 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 Processor -- start 2020-07-06T13:22:09.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 -- - start start 2020-07-06T13:22:09.825 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 -- - --> 172.21.15.118:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c0a3b80 con 0 2020-07-06T13:22:09.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c0a6760 con 0 2020-07-06T13:22:09.826 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f070ad71700 1 -- 172.21.15.118:0/1590365427 learned_addr learned my addr 172.21.15.118:0/1590365427 2020-07-06T13:22:09.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.1 172.21.15.118:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f0704003f60 con 0x7f070c0a3190 2020-07-06T13:22:09.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.1 172.21.15.118:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2388544403 0 0) 0x7f07040034c0 con 0x7f070c0a3190 2020-07-06T13:22:09.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06f0002960 con 0 2020-07-06T13:22:09.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f06f40011d0 con 0x7f070c0a6110 2020-07-06T13:22:09.828 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3990781156 0 0) 0x7f06f4002370 con 0x7f070c0a6110 2020-07-06T13:22:09.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06f0004620 con 0 2020-07-06T13:22:09.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.1 172.21.15.118:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (846721886 0 0) 0x7f07040039f0 con 0x7f070c0a3190 2020-07-06T13:22:09.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06f0002ee0 con 0 2020-07-06T13:22:09.829 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3994671591 0 0) 0x7f06f40026f0 con 0x7f070c0a6110 2020-07-06T13:22:09.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06f0003540 con 0 2020-07-06T13:22:09.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1682165622 0 0) 0x7f06f40018f0 con 0x7f070c0a6110 2020-07-06T13:22:09.831 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 >> 172.21.15.118:6790/0 conn(0x7f070c0a3190 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-07-06T13:22:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c07aa40 con 0 2020-07-06T13:22:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c0b2540 con 0 2020-07-06T13:22:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0710da1700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c18ae10 con 0 2020-07-06T13:22:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f06f4000f70 con 0x7f070c0a6110 2020-07-06T13:22:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7f06f4001d20 con 0x7f070c0a6110 2020-07-06T13:22:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7f06f4003770 con 0x7f070c0a6110 2020-07-06T13:22:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.824 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7f06f40050e0 con 0x7f070c0a6110 2020-07-06T13:22:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.832 7f0710da1700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c07adc0 con 0 2020-07-06T13:22:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.836 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f070c07adc0 con 0x7f070c0a6110 2020-07-06T13:22:09.927 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.924 7f0710da1700 1 -- 172.21.15.118:0/1590365427 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f070c0730e0 con 0 2020-07-06T13:22:09.928 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0703fff700 1 -- 172.21.15.118:0/1590365427 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2251 (581493562 0 907468826) 0x7f06f4003250 con 0x7f070c0a6110 2020-07-06T13:22:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:09.931 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:22:03.786063","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:09.931 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2020-07-06T13:22:09.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 >> 172.21.15.118:6800/9723 conn(0x7f06f0006e90 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-07-06T13:22:09.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 >> 172.21.15.118:6791/0 conn(0x7f070c0a6110 :-1 s=STATE_OPEN pgs=123 cs=1 l=1).mark_down 2020-07-06T13:22:09.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 shutdown_connections 2020-07-06T13:22:09.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 shutdown_connections 2020-07-06T13:22:09.932 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 wait complete. 2020-07-06T13:22:09.933 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:09.928 7f0710da1700 1 -- 172.21.15.118:0/1590365427 >> 172.21.15.118:0/1590365427 conn(0x7f070c099280 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:14.943 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:15.034 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:15.041 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e28f3700 1 Processor -- start 2020-07-06T13:22:15.041 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e28f3700 1 -- - start start 2020-07-06T13:22:15.042 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e28f3700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc14ba90 con 0 2020-07-06T13:22:15.042 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e28f3700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc14be30 con 0 2020-07-06T13:22:15.042 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e0919700 1 -- 172.21.15.118:0/4177922363 learned_addr learned my addr 172.21.15.118:0/4177922363 2020-07-06T13:22:15.043 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8c80022a0 con 0x7ff8dc14b350 2020-07-06T13:22:15.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8d0003630 con 0x7ff8dc148050 2020-07-06T13:22:15.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (66790002 0 0) 0x7ff8c8002620 con 0x7ff8dc14b350 2020-07-06T13:22:15.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff8c0002ea0 con 0 2020-07-06T13:22:15.044 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (355148376 0 0) 0x7ff8d00039b0 con 0x7ff8dc148050 2020-07-06T13:22:15.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff8c00046b0 con 0 2020-07-06T13:22:15.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1848987484 0 0) 0x7ff8d0003e50 con 0x7ff8dc148050 2020-07-06T13:22:15.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 >> 172.21.15.118:6791/0 conn(0x7ff8dc14b350 :-1 s=STATE_OPEN pgs=124 cs=1 l=1).mark_down 2020-07-06T13:22:15.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc07a7f0 con 0 2020-07-06T13:22:15.045 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.0 172.21.15.118:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff8dc0e9f70 con 0x7ff8dc148050 2020-07-06T13:22:15.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8db7fe700 1 -- 172.21.15.118:0/4177922363 <== mon.0 172.21.15.118:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8d0001010 con 0x7ff8dc148050 2020-07-06T13:22:15.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.040 7ff8e28f3700 1 -- 172.21.15.118:0/4177922363 >> 172.21.15.118:6789/0 conn(0x7ff8dc148050 :-1 s=STATE_OPEN pgs=118 cs=1 l=1).mark_down 2020-07-06T13:22:15.046 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.044 7ff8e28f3700 1 -- 172.21.15.118:0/4177922363 shutdown_connections 2020-07-06T13:22:15.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.044 7ff8e28f3700 1 -- 172.21.15.118:0/4177922363 shutdown_connections 2020-07-06T13:22:15.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.044 7ff8e28f3700 1 -- 172.21.15.118:0/4177922363 wait complete. 2020-07-06T13:22:15.047 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.044 7ff8e28f3700 1 -- 172.21.15.118:0/4177922363 >> 172.21.15.118:0/4177922363 conn(0x7ff8dc143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:15.048 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.044 7ff8e28f3700 1 Processor -- start 2020-07-06T13:22:15.048 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8e28f3700 1 -- - start start 2020-07-06T13:22:15.050 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8e28f3700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0a3db0 con 0 2020-07-06T13:22:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8e28f3700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0a52d0 con 0 2020-07-06T13:22:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8dbfff700 1 -- 172.21.15.118:0/4007998488 learned_addr learned my addr 172.21.15.118:0/4007998488 2020-07-06T13:22:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8c8001ff0 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3123068503 0 0) 0x7ff8c8002270 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff8c4002960 con 0 2020-07-06T13:22:15.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8d0000e50 con 0x7ff8dc095c00 2020-07-06T13:22:15.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1670395444 0 0) 0x7ff8d0003440 con 0x7ff8dc095c00 2020-07-06T13:22:15.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff8c4004620 con 0 2020-07-06T13:22:15.052 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1112330642 0 0) 0x7ff8c8000e50 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8c4002ee0 con 0 2020-07-06T13:22:15.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1835222930 0 0) 0x7ff8d00038f0 con 0x7ff8dc095c00 2020-07-06T13:22:15.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8c4003540 con 0 2020-07-06T13:22:15.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1023041817 0 0) 0x7ff8c80014b0 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.053 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 >> 172.21.15.118:6791/0 conn(0x7ff8dc095c00 :-1 s=STATE_OPEN pgs=125 cs=1 l=1).mark_down 2020-07-06T13:22:15.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc07aa50 con 0 2020-07-06T13:22:15.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc0b2840 con 0 2020-07-06T13:22:15.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc0a6c00 con 0 2020-07-06T13:22:15.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff8dc116e00 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.054 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7ff8c80018e0 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.055 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7ff8c80044b0 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.055 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.048 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7ff8c8005f60 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.055 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.052 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b8002050 con 0 2020-07-06T13:22:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.056 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff8c8004880 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.153 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 --> 172.21.15.118:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8b80011b0 con 0 2020-07-06T13:22:15.154 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8d9ffb700 1 -- 172.21.15.118:0/4007998488 <== mon.0 172.21.15.118:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2251 (581493562 0 907468826) 0x7ff8c8003f90 con 0x7ff8dc0a33c0 2020-07-06T13:22:15.154 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2020-07-06T13:22:15.155 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:15.155 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6818/236406258","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6817/4280428136","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:22:03.786063","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:15.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 >> 172.21.15.118:6800/9723 conn(0x7ff8c40064e0 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-07-06T13:22:15.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 >> 172.21.15.118:6789/0 conn(0x7ff8dc0a33c0 :-1 s=STATE_OPEN pgs=119 cs=1 l=1).mark_down 2020-07-06T13:22:15.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 shutdown_connections 2020-07-06T13:22:15.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 shutdown_connections 2020-07-06T13:22:15.156 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 wait complete. 2020-07-06T13:22:15.157 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:15.152 7ff8e28f3700 1 -- 172.21.15.118:0/4007998488 >> 172.21.15.118:0/4007998488 conn(0x7ff8dc099560 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:20.165 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-06T13:22:20.259 INFO:teuthology.orchestra.run.smithi118.stderr:WARNING: ignoring --log-early option (not implemented) 2020-07-06T13:22:20.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 Processor -- start 2020-07-06T13:22:20.265 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 -- - start start 2020-07-06T13:22:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52414ba90 con 0 2020-07-06T13:22:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52414be30 con 0 2020-07-06T13:22:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd5237fe700 1 -- 172.21.15.118:0/3609678429 learned_addr learned my addr 172.21.15.118:0/3609678429 2020-07-06T13:22:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd518003630 con 0x7fd52414b350 2020-07-06T13:22:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd5140022a0 con 0x7fd524148050 2020-07-06T13:22:20.268 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (26236840 0 0) 0x7fd5180039b0 con 0x7fd52414b350 2020-07-06T13:22:20.268 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd510002ea0 con 0 2020-07-06T13:22:20.268 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (198733320 0 0) 0x7fd5140025a0 con 0x7fd524148050 2020-07-06T13:22:20.268 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd5100046b0 con 0 2020-07-06T13:22:20.268 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2098089326 0 0) 0x7fd518003e50 con 0x7fd52414b350 2020-07-06T13:22:20.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 >> 172.21.15.118:6789/0 conn(0x7fd524148050 :-1 s=STATE_OPEN pgs=120 cs=1 l=1).mark_down 2020-07-06T13:22:20.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52407a7f0 con 0 2020-07-06T13:22:20.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.2 172.21.15.118:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd524116e00 con 0x7fd52414b350 2020-07-06T13:22:20.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd522ffd700 1 -- 172.21.15.118:0/3609678429 <== mon.2 172.21.15.118:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd518001010 con 0x7fd52414b350 2020-07-06T13:22:20.269 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 -- 172.21.15.118:0/3609678429 >> 172.21.15.118:6791/0 conn(0x7fd52414b350 :-1 s=STATE_OPEN pgs=126 cs=1 l=1).mark_down 2020-07-06T13:22:20.271 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.264 7fd52a23c700 1 -- 172.21.15.118:0/3609678429 shutdown_connections 2020-07-06T13:22:20.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- 172.21.15.118:0/3609678429 shutdown_connections 2020-07-06T13:22:20.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- 172.21.15.118:0/3609678429 wait complete. 2020-07-06T13:22:20.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- 172.21.15.118:0/3609678429 >> 172.21.15.118:0/3609678429 conn(0x7fd524143f80 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:20.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 Processor -- start 2020-07-06T13:22:20.272 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- - start start 2020-07-06T13:22:20.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- - --> 172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240a3c20 con 0 2020-07-06T13:22:20.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- - --> 172.21.15.118:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240a6960 con 0 2020-07-06T13:22:20.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd523fff700 1 -- 172.21.15.118:0/66414237 learned_addr learned my addr 172.21.15.118:0/66414237 2020-07-06T13:22:20.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd514002080 con 0x7fd5240a3230 2020-07-06T13:22:20.273 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1350079518 0 0) 0x7fd514002400 con 0x7fd5240a3230 2020-07-06T13:22:20.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd504002960 con 0 2020-07-06T13:22:20.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.0 172.21.15.118:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd518000e50 con 0x7fd5240a61b0 2020-07-06T13:22:20.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.0 172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2664405663 0 0) 0x7fd5180033e0 con 0x7fd5240a61b0 2020-07-06T13:22:20.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd504004620 con 0 2020-07-06T13:22:20.274 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (444491976 0 0) 0x7fd514000e50 con 0x7fd5240a3230 2020-07-06T13:22:20.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd504004fa0 con 0 2020-07-06T13:22:20.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (179899097 0 0) 0x7fd514001510 con 0x7fd5240a3230 2020-07-06T13:22:20.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 >> 172.21.15.118:6789/0 conn(0x7fd5240a61b0 :-1 s=STATE_OPEN pgs=121 cs=1 l=1).mark_down 2020-07-06T13:22:20.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52407aa50 con 0 2020-07-06T13:22:20.275 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240b2610 con 0 2020-07-06T13:22:20.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd52a23c700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52418b100 con 0 2020-07-06T13:22:20.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd514000bf0 con 0x7fd5240a3230 2020-07-06T13:22:20.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (4061802684 0 0) 0x7fd514001940 con 0x7fd5240a3230 2020-07-06T13:22:20.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (355089628 0 0) 0x7fd5140044b0 con 0x7fd5240a3230 2020-07-06T13:22:20.276 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.268 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 3119+0+0 (3326604042 0 0) 0x7fd514003f90 con 0x7fd5240a3230 2020-07-06T13:22:20.279 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.276 7fd52a23c700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500002050 con 0 2020-07-06T13:22:20.282 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.280 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd5140048d0 con 0x7fd5240a3230 2020-07-06T13:22:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.372 7fd52a23c700 1 -- 172.21.15.118:0/66414237 --> 172.21.15.118:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5000011b0 con 0 2020-07-06T13:22:20.376 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.372 7fd5217fa700 1 -- 172.21.15.118:0/66414237 <== mon.2 172.21.15.118:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1703 (882253904 0 2752134185) 0x7fd514004bc0 con 0x7fd5240a3230 2020-07-06T13:22:20.376 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2020-07-06T13:22:20.377 INFO:teuthology.orchestra.run.smithi118.stdout: 2020-07-06T13:22:20.377 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-06 13:18:57.751069","modified":"2020-07-06 13:22:03.786063","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.118:6819/1597074397","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-06T13:22:20.378 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 >> 172.21.15.118:6800/9723 conn(0x7fd504005720 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-07-06T13:22:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 >> 172.21.15.118:6791/0 conn(0x7fd5240a3230 :-1 s=STATE_OPEN pgs=127 cs=1 l=1).mark_down 2020-07-06T13:22:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 shutdown_connections 2020-07-06T13:22:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 shutdown_connections 2020-07-06T13:22:20.380 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 wait complete. 2020-07-06T13:22:20.380 INFO:teuthology.orchestra.run.smithi118.stderr:2020-07-06 13:22:20.376 7fd52a23c700 1 -- 172.21.15.118:0/66414237 >> 172.21.15.118:0/66414237 conn(0x7fd524099360 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-07-06T13:22:20.386 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:22:20.399 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2020-07-06T13:22:20.399 INFO:teuthology.run_tasks:Running task install.upgrade... 2020-07-06T13:22:20.426 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'} 2020-07-06T13:22:20.427 INFO:teuthology.task.install:remote ubuntu@smithi118.front.sepia.ceph.com config {'sha1': 'dd8f1a544d5c98277d42ecace4dad854c428b262'} 2020-07-06T13:22:20.427 INFO:teuthology.task.install:extra packages: [] 2020-07-06T13:22:20.427 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:22:20.480 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:22:20.485 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:22:20.495 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-07-06T13:22:20.496 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2020-07-06T13:22:20.496 INFO:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph-common 2020-07-06T13:22:20.518 INFO:teuthology.orchestra.run.smithi118.stdout:13.2.10-1bionic 2020-07-06T13:22:20.519 INFO:teuthology.packaging:The installed version of ceph-common is 13.2.10-1bionic 2020-07-06T13:22:20.519 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:22:20.611 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:22:20.616 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:22:20.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:22:20.802 INFO:teuthology.task.install:Ceph deb upgrade from 13.2.10-1bionic to 16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:22:20.802 INFO:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2020-07-06T13:22:20.912 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-07-06T13:22:20.966 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-07-06T13:22:20.966 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2020-07-06T13:22:20.967 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:22:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:22:21.022 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:22:21.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:22:21.199 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default/ 2020-07-06T13:22:21.199 INFO:teuthology.task.install.deb:Package version is 16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:22:21.351 INFO:teuthology.orchestra.run.smithi118:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-07-06T13:22:21.397 INFO:teuthology.orchestra.run.smithi118:> sudo apt-get update 2020-07-06T13:22:21.670 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic InRelease 2020-07-06T13:22:21.706 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-07-06T13:22:22.300 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-07-06T13:22:22.300 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-07-06T13:22:22.301 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic Release.gpg 2020-07-06T13:22:22.302 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.9 kB] 2020-07-06T13:22:22.302 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-07-06T13:22:22.302 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,070 B] 2020-07-06T13:22:22.302 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-07-06T13:22:22.310 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 26.7 kB in 1s (37.6 kB/s) 2020-07-06T13:22:23.520 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:22:23.561 INFO:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-2724-gdd8f1a5-1bionic cephadm=16.0.0-2724-gdd8f1a5-1bionic ceph-mds=16.0.0-2724-gdd8f1a5-1bionic ceph-mgr=16.0.0-2724-gdd8f1a5-1bionic ceph-common=16.0.0-2724-gdd8f1a5-1bionic ceph-fuse=16.0.0-2724-gdd8f1a5-1bionic ceph-test=16.0.0-2724-gdd8f1a5-1bionic radosgw=16.0.0-2724-gdd8f1a5-1bionic python3-rados=16.0.0-2724-gdd8f1a5-1bionic python3-rgw=16.0.0-2724-gdd8f1a5-1bionic python3-cephfs=16.0.0-2724-gdd8f1a5-1bionic python3-rbd=16.0.0-2724-gdd8f1a5-1bionic libcephfs2=16.0.0-2724-gdd8f1a5-1bionic libcephfs-dev=16.0.0-2724-gdd8f1a5-1bionic librados2=16.0.0-2724-gdd8f1a5-1bionic librbd1=16.0.0-2724-gdd8f1a5-1bionic rbd-fuse=16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:22:23.650 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2020-07-06T13:22:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2020-07-06T13:22:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2020-07-06T13:22:24.058 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2020-07-06T13:22:24.059 INFO:teuthology.orchestra.run.smithi118.stdout: formencode-i18n libjs-sphinxdoc libjs-underscore python-bcrypt python-bs4 2020-07-06T13:22:24.059 INFO:teuthology.orchestra.run.smithi118.stdout: python-ceph-argparse python-certifi python-chardet python-cherrypy3 2020-07-06T13:22:24.059 INFO:teuthology.orchestra.run.smithi118.stdout: python-dnspython python-formencode python-html5lib python-jinja2 2020-07-06T13:22:24.059 INFO:teuthology.orchestra.run.smithi118.stdout: python-logutils python-lxml python-mako python-markupsafe python-openid 2020-07-06T13:22:24.060 INFO:teuthology.orchestra.run.smithi118.stdout: python-paste python-pastedeploy python-pastescript python-pecan 2020-07-06T13:22:24.060 INFO:teuthology.orchestra.run.smithi118.stdout: python-prettytable python-pyinotify python-rbd python-repoze.lru 2020-07-06T13:22:24.060 INFO:teuthology.orchestra.run.smithi118.stdout: python-requests python-routes python-scgi python-simplegeneric 2020-07-06T13:22:24.060 INFO:teuthology.orchestra.run.smithi118.stdout: python-simplejson python-singledispatch python-tempita python-urllib3 2020-07-06T13:22:24.060 INFO:teuthology.orchestra.run.smithi118.stdout: python-waitress python-webencodings python-webob python-webtest 2020-07-06T13:22:24.061 INFO:teuthology.orchestra.run.smithi118.stdout: python-werkzeug 2020-07-06T13:22:24.061 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-06T13:22:24.062 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2020-07-06T13:22:24.062 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-07-06T13:22:24.062 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-07-06T13:22:24.062 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook ceph-mon ceph-osd librabbitmq4 libradosstriper1 librdkafka1 2020-07-06T13:22:24.062 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 python-attr python-funcsigs python-pluggy python-py python-pytest 2020-07-06T13:22:24.063 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-07-06T13:22:24.063 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-07-06T13:22:24.063 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-07-06T13:22:24.063 INFO:teuthology.orchestra.run.smithi118.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-07-06T13:22:24.063 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-06T13:22:24.064 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-06T13:22:24.064 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-07-06T13:22:24.064 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-07-06T13:22:24.064 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-07-06T13:22:24.064 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-07-06T13:22:24.065 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-07-06T13:22:24.065 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-07-06T13:22:24.065 INFO:teuthology.orchestra.run.smithi118.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-07-06T13:22:24.065 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-07-06T13:22:24.065 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-07-06T13:22:24.066 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-07-06T13:22:24.066 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest python3-werkzeug 2020-07-06T13:22:24.066 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2020-07-06T13:22:24.067 INFO:teuthology.orchestra.run.smithi118.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-07-06T13:22:24.067 INFO:teuthology.orchestra.run.smithi118.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-07-06T13:22:24.067 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-07-06T13:22:24.067 INFO:teuthology.orchestra.run.smithi118.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-07-06T13:22:24.068 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-07-06T13:22:24.068 INFO:teuthology.orchestra.run.smithi118.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-07-06T13:22:24.068 INFO:teuthology.orchestra.run.smithi118.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-07-06T13:22:24.068 INFO:teuthology.orchestra.run.smithi118.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-07-06T13:22:24.068 INFO:teuthology.orchestra.run.smithi118.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-07-06T13:22:24.069 INFO:teuthology.orchestra.run.smithi118.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-07-06T13:22:24.164 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be REMOVED: 2020-07-06T13:22:24.164 INFO:teuthology.orchestra.run.smithi118.stdout: python-cephfs python-rados python-rgw 2020-07-06T13:22:24.164 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2020-07-06T13:22:24.165 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-07-06T13:22:24.165 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-07-06T13:22:24.166 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook cephadm librabbitmq4 librdkafka1 python-attr python-funcsigs 2020-07-06T13:22:24.166 INFO:teuthology.orchestra.run.smithi118.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-07-06T13:22:24.166 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt python3-bs4 python3-ceph-common python3-cffi-backend 2020-07-06T13:22:24.167 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-07-06T13:22:24.167 INFO:teuthology.orchestra.run.smithi118.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-07-06T13:22:24.167 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-06T13:22:24.167 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-06T13:22:24.167 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-07-06T13:22:24.168 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-07-06T13:22:24.168 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-07-06T13:22:24.168 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-07-06T13:22:24.168 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-07-06T13:22:24.169 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest python3-werkzeug 2020-07-06T13:22:24.170 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2020-07-06T13:22:24.170 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-07-06T13:22:24.171 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test libcephfs-dev libcephfs2 librados2 libradosstriper1 librbd1 2020-07-06T13:22:24.171 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 python3-ceph-argparse python3-cephfs python3-rados python3-rbd 2020-07-06T13:22:24.171 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw radosgw rbd-fuse 2020-07-06T13:22:24.358 INFO:teuthology.orchestra.run.smithi118.stdout:22 upgraded, 79 newly installed, 3 to remove and 1 not upgraded. 2020-07-06T13:22:24.358 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 162 MB of archives. 2020-07-06T13:22:24.358 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 479 MB of additional disk space will be used. 2020-07-06T13:22:24.358 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-07-06T13:22:24.370 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 16.0.0-2724-gdd8f1a5-1bionic [418 kB] 2020-07-06T13:22:24.599 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-07-06T13:22:24.697 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 16.0.0-2724-gdd8f1a5-1bionic [9,074 kB] 2020-07-06T13:22:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-07-06T13:22:24.842 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-07-06T13:22:24.863 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-07-06T13:22:24.878 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-07-06T13:22:24.922 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-07-06T13:22:24.927 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-07-06T13:22:24.930 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-07-06T13:22:24.949 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-07-06T13:22:24.950 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-07-06T13:22:24.953 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-07-06T13:22:24.965 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-07-06T13:22:24.971 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-07-06T13:22:24.973 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-07-06T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-07-06T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-07-06T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-07-06T13:22:25.055 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-07-06T13:22:25.056 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-07-06T13:22:25.082 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-07-06T13:22:25.083 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-07-06T13:22:25.126 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-07-06T13:22:25.130 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-07-06T13:22:25.140 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-07-06T13:22:25.207 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-07-06T13:22:25.207 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-07-06T13:22:25.210 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-07-06T13:22:25.211 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-07-06T13:22:25.212 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-07-06T13:22:25.299 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-07-06T13:22:25.299 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-07-06T13:22:25.557 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 16.0.0-2724-gdd8f1a5-1bionic [1,357 kB] 2020-07-06T13:22:25.572 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-07-06T13:22:25.610 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 16.0.0-2724-gdd8f1a5-1bionic [6,593 kB] 2020-07-06T13:22:25.618 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-07-06T13:22:25.620 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-07-06T13:22:25.655 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-07-06T13:22:25.656 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-07-06T13:22:25.656 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-07-06T13:22:25.657 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-07-06T13:22:25.657 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-07-06T13:22:25.657 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-07-06T13:22:25.658 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-07-06T13:22:25.734 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-07-06T13:22:25.736 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-07-06T13:22:25.815 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-07-06T13:22:25.815 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-07-06T13:22:25.819 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-07-06T13:22:25.819 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-07-06T13:22:25.820 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-07-06T13:22:25.820 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-07-06T13:22:25.821 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-07-06T13:22:25.821 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-07-06T13:22:25.835 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 16.0.0-2724-gdd8f1a5-1bionic [1,942 kB] 2020-07-06T13:22:25.895 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-07-06T13:22:25.899 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 16.0.0-2724-gdd8f1a5-1bionic [3,804 B] 2020-07-06T13:22:25.899 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 16.0.0-2724-gdd8f1a5-1bionic [24.6 MB] 2020-07-06T13:22:25.899 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-07-06T13:22:25.975 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-07-06T13:22:25.976 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-07-06T13:22:25.976 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-07-06T13:22:25.978 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-07-06T13:22:25.990 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-07-06T13:22:25.991 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-07-06T13:22:25.991 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-07-06T13:22:26.084 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-07-06T13:22:26.085 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-07-06T13:22:26.086 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.2 [329 kB] 2020-07-06T13:22:26.136 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-07-06T13:22:26.137 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-07-06T13:22:26.138 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-07-06T13:22:26.139 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-07-06T13:22:26.142 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-07-06T13:22:26.143 INFO:teuthology.orchestra.run.smithi118.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-07-06T13:22:26.711 INFO:teuthology.orchestra.run.smithi118.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 16.0.0-2724-gdd8f1a5-1bionic [47.3 MB] 2020-07-06T13:22:28.275 INFO:teuthology.orchestra.run.smithi118.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 16.0.0-2724-gdd8f1a5-1bionic [5,628 kB] 2020-07-06T13:22:28.455 INFO:teuthology.orchestra.run.smithi118.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 16.0.0-2724-gdd8f1a5-1bionic [19.6 MB] 2020-07-06T13:22:29.099 INFO:teuthology.orchestra.run.smithi118.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 16.0.0-2724-gdd8f1a5-1bionic [19.1 kB] 2020-07-06T13:22:29.099 INFO:teuthology.orchestra.run.smithi118.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 16.0.0-2724-gdd8f1a5-1bionic [168 kB] 2020-07-06T13:22:29.102 INFO:teuthology.orchestra.run.smithi118.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 16.0.0-2724-gdd8f1a5-1bionic [463 kB] 2020-07-06T13:22:29.117 INFO:teuthology.orchestra.run.smithi118.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 16.0.0-2724-gdd8f1a5-1bionic [20.6 kB] 2020-07-06T13:22:29.118 INFO:teuthology.orchestra.run.smithi118.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 16.0.0-2724-gdd8f1a5-1bionic [99.2 kB] 2020-07-06T13:22:29.121 INFO:teuthology.orchestra.run.smithi118.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 16.0.0-2724-gdd8f1a5-1bionic [347 kB] 2020-07-06T13:22:29.134 INFO:teuthology.orchestra.run.smithi118.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 16.0.0-2724-gdd8f1a5-1bionic [1,688 kB] 2020-07-06T13:22:29.188 INFO:teuthology.orchestra.run.smithi118.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 16.0.0-2724-gdd8f1a5-1bionic [2,941 kB] 2020-07-06T13:22:29.285 INFO:teuthology.orchestra.run.smithi118.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 16.0.0-2724-gdd8f1a5-1bionic [3,153 kB] 2020-07-06T13:22:29.388 INFO:teuthology.orchestra.run.smithi118.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 16.0.0-2724-gdd8f1a5-1bionic [142 kB] 2020-07-06T13:22:29.392 INFO:teuthology.orchestra.run.smithi118.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 16.0.0-2724-gdd8f1a5-1bionic [24.8 kB] 2020-07-06T13:22:29.393 INFO:teuthology.orchestra.run.smithi118.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 16.0.0-2724-gdd8f1a5-1bionic [310 kB] 2020-07-06T13:22:29.403 INFO:teuthology.orchestra.run.smithi118.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 16.0.0-2724-gdd8f1a5-1bionic [543 kB] 2020-07-06T13:22:29.421 INFO:teuthology.orchestra.run.smithi118.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 16.0.0-2724-gdd8f1a5-1bionic [42.4 kB] 2020-07-06T13:22:29.422 INFO:teuthology.orchestra.run.smithi118.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 16.0.0-2724-gdd8f1a5-1bionic [43.2 kB] 2020-07-06T13:22:29.425 INFO:teuthology.orchestra.run.smithi118.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 16.0.0-2724-gdd8f1a5-1bionic [3,121 kB] 2020-07-06T13:22:29.527 INFO:teuthology.orchestra.run.smithi118.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 16.0.0-2724-gdd8f1a5-1bionic [34.2 kB] 2020-07-06T13:22:29.528 INFO:teuthology.orchestra.run.smithi118.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 16.0.0-2724-gdd8f1a5-1bionic [7,887 kB] 2020-07-06T13:22:29.787 INFO:teuthology.orchestra.run.smithi118.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 16.0.0-2724-gdd8f1a5-1bionic [3,920 B] 2020-07-06T13:22:29.788 INFO:teuthology.orchestra.run.smithi118.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 16.0.0-2724-gdd8f1a5-1bionic [22.3 kB] 2020-07-06T13:22:29.788 INFO:teuthology.orchestra.run.smithi118.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-fix-setxattr-client10/dd8f1a544d5c98277d42ecace4dad854c428b262/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 16.0.0-2724-gdd8f1a5-1bionic [79.3 kB] 2020-07-06T13:22:30.590 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 162 MB in 6s (28.9 MB/s) 2020-07-06T13:22:30.751 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 105072 files and directories currently installed.) 2020-07-06T13:22:30.754 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../0-libradosstriper1_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:30.900 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:31.366 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../1-radosgw_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:31.489 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:32.891 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../2-ceph-mgr_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:33.079 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:33.704 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../3-ceph-mon_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:33.969 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:34.995 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../4-ceph-mds_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:35.116 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:35.675 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../5-ceph_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:35.813 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:36.262 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../6-ceph-osd_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:36.443 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:38.633 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../7-ceph-test_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:38.768 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:42.479 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../8-ceph-base_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:42.681 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:43.787 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../9-ceph-common_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:43.909 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:45.789 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104535 files and directories currently installed.) 2020-07-06T13:22:45.799 INFO:teuthology.orchestra.run.smithi118.stdout:Removing python-rgw (13.2.10-1bionic) ... 2020-07-06T13:22:46.176 INFO:teuthology.orchestra.run.smithi118.stdout:Removing python-cephfs (13.2.10-1bionic) ... 2020-07-06T13:22:46.618 INFO:teuthology.orchestra.run.smithi118.stdout:Removing python-rados (13.2.10-1bionic) ... 2020-07-06T13:22:47.140 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104514 files and directories currently installed.) 2020-07-06T13:22:47.143 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../00-libcephfs-dev_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:47.264 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:47.605 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../01-python3-cephfs_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:47.811 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:48.160 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../02-libcephfs2_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:48.282 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:48.715 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../03-python3-ceph-argparse_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:22:48.928 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:49.270 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../04-python3-rgw_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:49.374 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:49.698 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../05-python3-rados_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:49.820 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:50.218 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../06-librbd1_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:50.324 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:50.857 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../07-librgw2_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:50.980 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:51.612 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../08-librados2_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:22:51.734 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:22:52.396 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-07-06T13:22:52.407 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../09-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-07-06T13:22:52.446 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-07-06T13:22:52.732 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-07-06T13:22:52.745 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../10-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-07-06T13:22:52.774 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-07-06T13:22:53.144 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-dateutil. 2020-07-06T13:22:53.155 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../11-python3-dateutil_2.6.1-1_all.deb ... 2020-07-06T13:22:53.193 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-07-06T13:22:53.522 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-asn1crypto. 2020-07-06T13:22:53.534 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../12-python3-asn1crypto_0.24.0-1_all.deb ... 2020-07-06T13:22:53.572 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-07-06T13:22:53.841 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cffi-backend. 2020-07-06T13:22:53.853 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../13-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-07-06T13:22:53.891 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-07-06T13:22:54.202 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cryptography. 2020-07-06T13:22:54.216 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../14-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-07-06T13:22:54.244 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-07-06T13:22:55.348 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-openssl. 2020-07-06T13:22:55.360 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../15-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-07-06T13:22:55.398 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:22:55.643 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-07-06T13:22:55.654 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../16-ceph-mgr-modules-core_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:22:55.693 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-modules-core (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:22:56.047 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bcrypt. 2020-07-06T13:22:56.060 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../17-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-07-06T13:22:56.097 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-07-06T13:22:56.399 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cherrypy3. 2020-07-06T13:22:56.406 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../18-python3-cherrypy3_8.9.1-2_all.deb ... 2020-07-06T13:22:56.450 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-07-06T13:22:56.786 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jwt. 2020-07-06T13:22:56.798 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../19-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-07-06T13:22:56.836 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-07-06T13:22:57.148 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-logutils. 2020-07-06T13:22:57.159 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../20-python3-logutils_0.3.3-5_all.deb ... 2020-07-06T13:22:57.198 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-07-06T13:22:57.501 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-markupsafe. 2020-07-06T13:22:57.512 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../21-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-07-06T13:22:57.543 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-07-06T13:22:57.846 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-mako. 2020-07-06T13:22:57.858 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../22-python3-mako_1.0.7+ds1-1_all.deb ... 2020-07-06T13:22:57.896 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-07-06T13:22:58.207 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplegeneric. 2020-07-06T13:22:58.219 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../23-python3-simplegeneric_0.8.1-1_all.deb ... 2020-07-06T13:22:58.257 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-07-06T13:22:58.560 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-singledispatch. 2020-07-06T13:22:58.571 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../24-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-07-06T13:22:58.610 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-07-06T13:22:58.905 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webob. 2020-07-06T13:22:58.915 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../25-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-07-06T13:22:58.954 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:22:59.258 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bs4. 2020-07-06T13:22:59.271 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../26-python3-bs4_4.6.0-1_all.deb ... 2020-07-06T13:22:59.316 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-07-06T13:22:59.644 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-waitress. 2020-07-06T13:22:59.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../27-python3-waitress_1.0.1-1_all.deb ... 2020-07-06T13:22:59.694 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-07-06T13:23:00.006 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempita. 2020-07-06T13:23:00.018 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../28-python3-tempita_0.5.2-2_all.deb ... 2020-07-06T13:23:00.056 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-07-06T13:23:00.367 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-paste. 2020-07-06T13:23:00.379 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../29-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-07-06T13:23:00.417 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:23:00.762 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastedeploy. 2020-07-06T13:23:00.776 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../30-python3-pastedeploy_1.5.2-4_all.deb ... 2020-07-06T13:23:00.812 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-07-06T13:23:01.107 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webtest. 2020-07-06T13:23:01.118 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../31-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-07-06T13:23:01.157 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:23:01.493 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pecan. 2020-07-06T13:23:01.505 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../32-python3-pecan_1.2.1-2_all.deb ... 2020-07-06T13:23:01.547 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-07-06T13:23:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-werkzeug. 2020-07-06T13:23:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../33-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-07-06T13:23:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:23:02.276 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-common. 2020-07-06T13:23:02.289 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../34-python3-ceph-common_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:02.326 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-common (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:02.654 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-prettytable. 2020-07-06T13:23:02.666 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../35-python3-prettytable_0.7.2-3_all.deb ... 2020-07-06T13:23:02.704 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-07-06T13:23:02.978 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../36-python3-rbd_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:23:03.124 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:23:03.486 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-uritemplate. 2020-07-06T13:23:03.500 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../37-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-07-06T13:23:03.537 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-07-06T13:23:03.886 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../38-ceph-fuse_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:23:04.015 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:23:04.920 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephadm. 2020-07-06T13:23:04.934 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../39-cephadm_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:23:04.970 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephadm (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:05.282 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jinja2. 2020-07-06T13:23:05.293 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../40-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-07-06T13:23:05.331 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:23:05.651 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-07-06T13:23:05.663 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../41-ceph-mgr-cephadm_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:05.701 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-cephadm (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:06.030 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-repoze.lru. 2020-07-06T13:23:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../42-python3-repoze.lru_0.7-1_all.deb ... 2020-07-06T13:23:06.079 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-07-06T13:23:06.383 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-routes. 2020-07-06T13:23:06.395 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../43-python3-routes_2.4.1-1_all.deb ... 2020-07-06T13:23:06.432 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-07-06T13:23:06.744 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-07-06T13:23:06.756 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../44-ceph-mgr-dashboard_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:06.794 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-dashboard (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:07.634 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-07-06T13:23:07.647 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../45-ceph-mgr-diskprediction-cloud_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:07.684 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-cloud (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:07.987 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-numpy. 2020-07-06T13:23:07.999 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../46-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-07-06T13:23:08.037 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-07-06T13:23:08.612 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-decorator. 2020-07-06T13:23:08.621 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../47-python3-decorator_4.1.2-1_all.deb ... 2020-07-06T13:23:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-07-06T13:23:08.987 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-scipy. 2020-07-06T13:23:09.001 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../48-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-07-06T13:23:09.046 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-07-06T13:23:10.222 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-07-06T13:23:10.236 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../49-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-07-06T13:23:10.272 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-07-06T13:23:10.759 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-joblib. 2020-07-06T13:23:10.773 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../50-python3-joblib_0.11-1_all.deb ... 2020-07-06T13:23:10.817 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-joblib (0.11-1) ... 2020-07-06T13:23:11.163 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn. 2020-07-06T13:23:11.175 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../51-python3-sklearn_0.19.1-3_all.deb ... 2020-07-06T13:23:11.212 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-07-06T13:23:11.777 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-07-06T13:23:11.790 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../52-ceph-mgr-diskprediction-local_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:11.827 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:12.947 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-monotonic. 2020-07-06T13:23:12.961 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../53-python3-monotonic_1.1-2_all.deb ... 2020-07-06T13:23:13.005 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-07-06T13:23:13.292 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-fasteners. 2020-07-06T13:23:13.305 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../54-python3-fasteners_0.12.0-3_all.deb ... 2020-07-06T13:23:13.350 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-07-06T13:23:13.645 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-httplib2. 2020-07-06T13:23:13.657 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../55-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-07-06T13:23:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-07-06T13:23:13.998 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1. 2020-07-06T13:23:14.012 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../56-python3-pyasn1_0.4.2-3_all.deb ... 2020-07-06T13:23:14.056 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-07-06T13:23:14.359 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-07-06T13:23:14.371 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../57-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-07-06T13:23:14.401 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-07-06T13:23:14.687 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rsa. 2020-07-06T13:23:14.699 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../58-python3-rsa_3.4.2-1_all.deb ... 2020-07-06T13:23:14.730 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-07-06T13:23:15.091 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-07-06T13:23:15.104 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../59-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-07-06T13:23:15.149 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-07-06T13:23:15.562 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-oauth2client. 2020-07-06T13:23:15.574 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../60-python3-oauth2client_4.1.2-3_all.deb ... 2020-07-06T13:23:15.612 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-07-06T13:23:15.974 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-setuptools. 2020-07-06T13:23:15.986 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../61-python3-setuptools_39.0.1-2_all.deb ... 2020-07-06T13:23:16.023 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-07-06T13:23:16.394 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-websocket. 2020-07-06T13:23:16.406 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../62-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-07-06T13:23:16.444 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-07-06T13:23:16.730 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-kubernetes. 2020-07-06T13:23:16.742 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../63-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-07-06T13:23:16.780 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-07-06T13:23:17.201 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-07-06T13:23:17.215 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../64-ceph-mgr-k8sevents_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:17.259 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:17.596 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-json-pointer. 2020-07-06T13:23:17.609 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../65-python3-json-pointer_1.10-1_all.deb ... 2020-07-06T13:23:17.646 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-07-06T13:23:17.999 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jsonpatch. 2020-07-06T13:23:18.011 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../66-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-07-06T13:23:18.052 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-06T13:23:18.327 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-07-06T13:23:18.339 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../67-ceph-mgr-rook_16.0.0-2724-gdd8f1a5-1bionic_all.deb ... 2020-07-06T13:23:18.377 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-rook (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:18.680 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-attr. 2020-07-06T13:23:18.705 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../68-python-attr_17.4.0-2_all.deb ... 2020-07-06T13:23:18.730 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-attr (17.4.0-2) ... 2020-07-06T13:23:19.075 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-funcsigs. 2020-07-06T13:23:19.086 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../69-python-funcsigs_1.0.2-4_all.deb ... 2020-07-06T13:23:19.124 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-07-06T13:23:19.394 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pluggy. 2020-07-06T13:23:19.407 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../70-python-pluggy_0.6.0-1_all.deb ... 2020-07-06T13:23:19.444 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-07-06T13:23:19.747 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-py. 2020-07-06T13:23:19.760 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../71-python-py_1.5.2-1_all.deb ... 2020-07-06T13:23:19.797 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-py (1.5.2-1) ... 2020-07-06T13:23:20.151 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pytest. 2020-07-06T13:23:20.164 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../72-python-pytest_3.3.2-2_all.deb ... 2020-07-06T13:23:20.242 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-07-06T13:23:20.665 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-attr. 2020-07-06T13:23:20.677 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../73-python3-attr_17.4.0-2_all.deb ... 2020-07-06T13:23:20.714 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-07-06T13:23:21.010 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cycler. 2020-07-06T13:23:21.020 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../74-python3-cycler_0.10.0-1_all.deb ... 2020-07-06T13:23:21.051 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-07-06T13:23:21.354 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webencodings. 2020-07-06T13:23:21.361 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../75-python3-webencodings_0.5-2_all.deb ... 2020-07-06T13:23:21.395 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-07-06T13:23:21.723 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-html5lib. 2020-07-06T13:23:21.735 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../76-python3-html5lib_0.999999999-1_all.deb ... 2020-07-06T13:23:21.773 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-07-06T13:23:22.119 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-07-06T13:23:22.132 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../77-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-07-06T13:23:22.177 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:23:22.605 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyparsing. 2020-07-06T13:23:22.618 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../78-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-07-06T13:23:22.655 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-07-06T13:23:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tz. 2020-07-06T13:23:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../79-python3-tz_2018.3-2_all.deb ... 2020-07-06T13:23:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tz (2018.3-2) ... 2020-07-06T13:23:23.353 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-matplotlib. 2020-07-06T13:23:23.366 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../80-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-07-06T13:23:23.403 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-07-06T13:23:24.058 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-olefile. 2020-07-06T13:23:24.070 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../81-python3-olefile_0.45.1-1_all.deb ... 2020-07-06T13:23:24.108 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-07-06T13:23:24.422 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastescript. 2020-07-06T13:23:24.433 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../82-python3-pastescript_2.0.2-2_all.deb ... 2020-07-06T13:23:24.478 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-07-06T13:23:24.807 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pil:amd64. 2020-07-06T13:23:24.819 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../83-python3-pil_5.1.0-1ubuntu0.2_amd64.deb ... 2020-07-06T13:23:24.856 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-07-06T13:23:25.227 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pluggy. 2020-07-06T13:23:25.239 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../84-python3-pluggy_0.6.0-1_all.deb ... 2020-07-06T13:23:25.277 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-07-06T13:23:25.580 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-py. 2020-07-06T13:23:25.591 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../85-python3-py_1.5.2-1_all.deb ... 2020-07-06T13:23:25.630 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-py (1.5.2-1) ... 2020-07-06T13:23:25.941 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyinotify. 2020-07-06T13:23:25.954 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../86-python3-pyinotify_0.9.6-1_all.deb ... 2020-07-06T13:23:26.016 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-07-06T13:23:26.336 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pytest. 2020-07-06T13:23:26.349 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../87-python3-pytest_3.3.2-2_all.deb ... 2020-07-06T13:23:26.378 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-07-06T13:23:26.731 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplejson. 2020-07-06T13:23:26.743 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../88-python3-simplejson_3.13.2-1_amd64.deb ... 2020-07-06T13:23:26.781 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-07-06T13:23:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tk:amd64. 2020-07-06T13:23:27.106 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../89-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-07-06T13:23:27.151 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-07-06T13:23:27.510 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../90-rbd-fuse_16.0.0-2724-gdd8f1a5-1bionic_amd64.deb ... 2020-07-06T13:23:27.630 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (16.0.0-2724-gdd8f1a5-1bionic) over (13.2.10-1bionic) ... 2020-07-06T13:23:27.976 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-07-06T13:23:28.278 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-06T13:23:28.638 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-07-06T13:23:28.764 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-07-06T13:23:29.400 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-07-06T13:23:29.776 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-07-06T13:23:30.044 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webencodings (0.5-2) ... 2020-07-06T13:23:30.329 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-attr (17.4.0-2) ... 2020-07-06T13:23:30.522 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-07-06T13:23:30.648 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-py (1.5.2-1) ... 2020-07-06T13:23:30.991 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-07-06T13:23:31.326 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-07-06T13:23:31.425 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-07-06T13:23:31.703 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-07-06T13:23:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:32.297 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-07-06T13:23:32.603 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-07-06T13:23:33.510 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-07-06T13:23:33.820 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-07-06T13:23:34.104 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-py (1.5.2-1) ... 2020-07-06T13:23:34.331 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-07-06T13:23:34.649 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-07-06T13:23:34.739 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-07-06T13:23:34.959 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-07-06T13:23:35.168 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-07-06T13:23:35.695 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-07-06T13:23:36.004 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-07-06T13:23:36.306 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-07-06T13:23:36.674 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-07-06T13:23:37.000 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-07-06T13:23:37.293 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephadm (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:37.929 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user cephadm....done 2020-07-06T13:23:38.075 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-07-06T13:23:38.376 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:38.494 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-07-06T13:23:38.829 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-07-06T13:23:39.122 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:39.248 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-07-06T13:23:39.591 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-common (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:39.918 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-monotonic (1.1-2) ... 2020-07-06T13:23:40.210 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:40.353 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-07-06T13:23:40.696 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-07-06T13:23:41.048 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-06T13:23:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-07-06T13:23:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-07-06T13:23:41.408 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-07-06T13:23:41.726 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-07-06T13:23:42.027 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:42.137 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-07-06T13:23:42.463 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-attr (17.4.0-2) ... 2020-07-06T13:23:42.773 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-07-06T13:23:42.966 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-07-06T13:23:43.367 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-07-06T13:23:43.669 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-07-06T13:23:43.751 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-07-06T13:23:44.012 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-07-06T13:23:44.130 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-07-06T13:23:44.390 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-07-06T13:23:44.775 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-07-06T13:23:45.059 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tz (2018.3-2) ... 2020-07-06T13:23:45.377 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-07-06T13:23:45.645 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-07-06T13:23:45.955 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-joblib (0.11-1) ... 2020-07-06T13:23:46.331 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-routes (2.4.1-1) ... 2020-07-06T13:23:46.616 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-07-06T13:23:46.925 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-07-06T13:23:47.244 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-07-06T13:23:47.595 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-07-06T13:23:47.880 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-07-06T13:23:49.052 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-07-06T13:23:49.353 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:49.462 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:49.739 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-07-06T13:23:50.057 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-07-06T13:23:50.200 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:50.326 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-07-06T13:23:50.702 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:51.062 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:51.163 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pytest (3.3.2-2) ... 2020-07-06T13:23:51.423 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-07-06T13:23:51.851 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-07-06T13:23:52.146 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-07-06T13:23:52.456 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-07-06T13:23:52.757 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-07-06T13:23:53.084 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:53.210 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-07-06T13:23:54.081 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:54.207 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-07-06T13:23:55.034 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:55.232 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-07-06T13:23:55.902 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-modules-core (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:56.053 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:56.087 INFO:teuthology.orchestra.run.smithi118.stdout:Installing new version of config file /etc/bash_completion.d/ceph ... 2020-07-06T13:23:56.121 INFO:teuthology.orchestra.run.smithi118.stdout:Installing new version of config file /etc/bash_completion.d/rados ... 2020-07-06T13:23:56.426 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties..usermod: no changes 2020-07-06T13:23:56.529 INFO:teuthology.orchestra.run.smithi118.stdout:..done 2020-07-06T13:23:56.546 INFO:teuthology.orchestra.run.smithi118.stdout:Fixing /var/run/ceph ownership....done 2020-07-06T13:23:57.027 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:57.069 INFO:teuthology.orchestra.run.smithi118.stdout:Installing new version of config file /etc/init.d/radosgw ... 2020-07-06T13:23:57.571 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:57.680 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:57.727 INFO:teuthology.orchestra.run.smithi118.stdout:Installing new version of config file /etc/init.d/ceph ... 2020-07-06T13:23:58.199 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:58.575 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:58.718 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:59.321 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-cephadm (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:59.456 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-cloud (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:59.599 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-rook (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:23:59.742 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:24:00.118 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:24:00.528 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-k8sevents (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:24:00.646 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-dashboard (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:24:00.789 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (16.0.0-2724-gdd8f1a5-1bionic) ... 2020-07-06T13:24:00.916 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for systemd (237-3ubuntu10.41) ... 2020-07-06T13:24:01.260 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-07-06T13:24:02.404 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-07-06T13:24:02.504 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-07-06T13:24:02.922 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-07-06T13:24:02.925 INFO:teuthology.orchestra.run.smithi118:> sudo lsb_release -is 2020-07-06T13:24:02.973 INFO:teuthology.orchestra.run.smithi118.stdout:Ubuntu 2020-07-06T13:24:02.978 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-07-06T13:24:02.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=dd8f1a544d5c98277d42ecace4dad854c428b262 2020-07-06T13:24:03.181 INFO:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2020-07-06T13:24:03.207 INFO:teuthology.orchestra.run.smithi118.stdout:16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:24:03.208 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-2724-gdd8f1a5-1bionic 2020-07-06T13:24:03.208 INFO:teuthology.task.install:The correct ceph version 16.0.0-2724-gdd8f1a5-1bionic is installed. 2020-07-06T13:24:03.208 INFO:teuthology.run_tasks:Running task print... 2020-07-06T13:24:03.222 INFO:teuthology.task.print:**** done install.upgrade both hosts 2020-07-06T13:24:03.223 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-07-06T13:24:03.245 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-07-06T13:24:03.245 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:24:03.267 INFO:tasks.ceph.mon.a:Stopped 2020-07-06T13:24:03.267 INFO:tasks.ceph.mon.a:Restarting daemon 2020-07-06T13:24:03.268 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-07-06T13:24:03.311 INFO:tasks.ceph.mon.a:Started 2020-07-06T13:24:03.312 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-07-06T13:24:03.312 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:24:03.329 INFO:tasks.ceph.mon.b:Stopped 2020-07-06T13:24:03.329 INFO:tasks.ceph.mon.b:Restarting daemon 2020-07-06T13:24:03.330 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-07-06T13:24:03.371 INFO:tasks.ceph.mon.b:Started 2020-07-06T13:24:03.372 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-07-06T13:24:03.372 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:24:03.394 INFO:tasks.ceph.mon.c:Stopped 2020-07-06T13:24:03.394 INFO:tasks.ceph.mon.c:Restarting daemon 2020-07-06T13:24:03.394 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-07-06T13:24:03.439 INFO:tasks.ceph.mon.c:Started 2020-07-06T13:24:03.439 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-07-06T13:24:03.440 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:24:03.447 INFO:tasks.ceph.mon.a.smithi118.stderr:2020-07-06T13:24:03.448+0000 7fcbbd247540 -1 mon.a@-1(probing) e1 current monmap has recorded min_mon_release 13 (mimic) is >2 releases older than installed 16 (pacific); you can only upgrade 2 releases at a time 2020-07-06T13:24:03.447 INFO:tasks.ceph.mon.a.smithi118.stderr:you should first upgrade to 14 (nautilus) or 15 (octopus) 2020-07-06T13:24:03.448 INFO:tasks.ceph.mon.a.smithi118.stderr: stopping. 2020-07-06T13:24:03.458 INFO:tasks.ceph.mgr.x:Stopped 2020-07-06T13:24:03.459 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-07-06T13:24:03.459 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-07-06T13:24:03.495 INFO:tasks.ceph.mon.b.smithi118.stderr:2020-07-06T13:24:03.496+0000 7fd76c180540 -1 mon.b@-1(probing) e1 current monmap has recorded min_mon_release 13 (mimic) is >2 releases older than installed 16 (pacific); you can only upgrade 2 releases at a time 2020-07-06T13:24:03.496 INFO:tasks.ceph.mon.b.smithi118.stderr:you should first upgrade to 14 (nautilus) or 15 (octopus) 2020-07-06T13:24:03.496 INFO:tasks.ceph.mon.b.smithi118.stderr: stopping. 2020-07-06T13:24:03.497 INFO:tasks.ceph.mgr.x:Started 2020-07-06T13:24:03.498 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-07-06T13:24:03.498 INFO:teuthology.orchestra.run:waiting for 300 2020-07-06T13:24:03.513 INFO:tasks.ceph.mgr.y:Stopped 2020-07-06T13:24:03.513 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-07-06T13:24:03.514 INFO:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-07-06T13:24:03.552 INFO:tasks.ceph.mon.c.smithi118.stderr:2020-07-06T13:24:03.552+0000 7f8cd4bb3540 -1 mon.c@-1(probing) e1 current monmap has recorded min_mon_release 13 (mimic) is >2 releases older than installed 16 (pacific); you can only upgrade 2 releases at a time 2020-07-06T13:24:03.553 INFO:tasks.ceph.mon.c.smithi118.stderr:you should first upgrade to 14 (nautilus) or 15 (octopus) 2020-07-06T13:24:03.553 INFO:tasks.ceph.mon.c.smithi118.stderr: stopping. 2020-07-06T13:24:03.554 INFO:tasks.ceph.mgr.y:Started 2020-07-06T13:24:03.555 INFO:teuthology.run_tasks:Running task exec... 2020-07-06T13:24:03.567 INFO:teuthology.task.exec:Executing custom commands... 2020-07-06T13:24:03.568 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi118.front.sepia.ceph.com 2020-07-06T13:24:03.568 INFO:teuthology.orchestra.run.smithi118:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set global mon_warn_on_msgr2_not_enabled false' 2020-07-06T13:24:06.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2020-07-06T13:24:06.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2020-07-06T13:24:06.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2020-07-06T13:24:12.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~6s 2020-07-06T13:24:12.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2020-07-06T13:24:12.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~6s 2020-07-06T13:24:17.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~11s 2020-07-06T13:24:17.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~11s 2020-07-06T13:24:17.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~11s 2020-07-06T13:24:23.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~17s 2020-07-06T13:24:23.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~17s 2020-07-06T13:24:23.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~17s 2020-07-06T13:24:29.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~23s 2020-07-06T13:24:29.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~23s 2020-07-06T13:24:29.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~23s 2020-07-06T13:24:35.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~29s 2020-07-06T13:24:35.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~29s 2020-07-06T13:24:35.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~29s 2020-07-06T13:24:40.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~34s 2020-07-06T13:24:40.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~34s 2020-07-06T13:24:40.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~34s 2020-07-06T13:24:46.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2020-07-06T13:24:46.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2020-07-06T13:24:46.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2020-07-06T13:24:52.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~46s 2020-07-06T13:24:52.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~46s 2020-07-06T13:24:52.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~46s 2020-07-06T13:24:57.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~51s 2020-07-06T13:24:57.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~51s 2020-07-06T13:24:57.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~51s 2020-07-06T13:25:03.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~57s 2020-07-06T13:25:03.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~57s 2020-07-06T13:25:03.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~57s 2020-07-06T13:25:09.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~63s 2020-07-06T13:25:09.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~63s 2020-07-06T13:25:09.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~63s 2020-07-06T13:25:15.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~68s 2020-07-06T13:25:15.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~68s 2020-07-06T13:25:15.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~68s 2020-07-06T13:25:20.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~74s 2020-07-06T13:25:20.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~74s 2020-07-06T13:25:20.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~74s 2020-07-06T13:25:26.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2020-07-06T13:25:26.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2020-07-06T13:25:26.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~80s 2020-07-06T13:25:32.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~86s 2020-07-06T13:25:32.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~86s 2020-07-06T13:25:32.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~86s 2020-07-06T13:25:37.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~91s 2020-07-06T13:25:37.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~91s 2020-07-06T13:25:37.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~91s 2020-07-06T13:25:43.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~97s 2020-07-06T13:25:43.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~97s 2020-07-06T13:25:43.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~97s 2020-07-06T13:25:49.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~103s 2020-07-06T13:25:49.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~103s 2020-07-06T13:25:49.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~103s 2020-07-06T13:25:54.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~108s 2020-07-06T13:25:54.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~108s 2020-07-06T13:25:54.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~108s 2020-07-06T13:26:00.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~114s 2020-07-06T13:26:00.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~114s 2020-07-06T13:26:00.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~114s 2020-07-06T13:26:06.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2020-07-06T13:26:06.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2020-07-06T13:26:06.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2020-07-06T13:26:12.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2020-07-06T13:26:12.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~126s 2020-07-06T13:26:12.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~126s 2020-07-06T13:26:17.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~131s 2020-07-06T13:26:17.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~131s 2020-07-06T13:26:17.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~131s 2020-07-06T13:26:23.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~137s 2020-07-06T13:26:23.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~137s 2020-07-06T13:26:23.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~137s 2020-07-06T13:26:29.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~143s 2020-07-06T13:26:29.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~143s 2020-07-06T13:26:29.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~143s 2020-07-06T13:26:34.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~148s 2020-07-06T13:26:34.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~148s 2020-07-06T13:26:34.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~148s 2020-07-06T13:26:40.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~154s 2020-07-06T13:26:40.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~154s 2020-07-06T13:26:40.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~154s 2020-07-06T13:26:46.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2020-07-06T13:26:46.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2020-07-06T13:26:46.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~160s 2020-07-06T13:26:52.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~166s 2020-07-06T13:26:52.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~166s 2020-07-06T13:26:52.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~166s 2020-07-06T13:26:57.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~171s 2020-07-06T13:26:57.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~171s 2020-07-06T13:26:57.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~171s 2020-07-06T13:27:03.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~177s 2020-07-06T13:27:03.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~177s 2020-07-06T13:27:03.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~177s 2020-07-06T13:27:09.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~183s 2020-07-06T13:27:09.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~183s 2020-07-06T13:27:09.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~183s 2020-07-06T13:27:14.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~188s 2020-07-06T13:27:14.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~188s 2020-07-06T13:27:14.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~188s 2020-07-06T13:27:20.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~194s 2020-07-06T13:27:20.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~194s 2020-07-06T13:27:20.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~194s 2020-07-06T13:27:26.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2020-07-06T13:27:26.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2020-07-06T13:27:26.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~200s 2020-07-06T13:27:31.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2020-07-06T13:27:31.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2020-07-06T13:27:31.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~205s 2020-07-06T13:27:37.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~211s 2020-07-06T13:27:37.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~211s 2020-07-06T13:27:37.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~211s 2020-07-06T13:27:43.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~217s 2020-07-06T13:27:43.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~217s 2020-07-06T13:27:43.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~217s 2020-07-06T13:27:49.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~223s 2020-07-06T13:27:49.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~223s 2020-07-06T13:27:49.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~223s 2020-07-06T13:27:54.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~228s 2020-07-06T13:27:54.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~228s 2020-07-06T13:27:54.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~228s 2020-07-06T13:28:00.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~234s 2020-07-06T13:28:00.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~234s 2020-07-06T13:28:00.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~234s 2020-07-06T13:28:06.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2020-07-06T13:28:06.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2020-07-06T13:28:06.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2020-07-06T13:28:11.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2020-07-06T13:28:11.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2020-07-06T13:28:11.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~245s 2020-07-06T13:28:17.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~251s 2020-07-06T13:28:17.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~251s 2020-07-06T13:28:17.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~251s 2020-07-06T13:28:23.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~257s 2020-07-06T13:28:23.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~257s 2020-07-06T13:28:23.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~257s 2020-07-06T13:28:29.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~263s 2020-07-06T13:28:29.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~263s 2020-07-06T13:28:29.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~263s 2020-07-06T13:28:34.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~268s 2020-07-06T13:28:34.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~268s 2020-07-06T13:28:34.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~268s 2020-07-06T13:28:40.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~274s 2020-07-06T13:28:40.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~274s 2020-07-06T13:28:40.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~274s 2020-07-06T13:28:46.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2020-07-06T13:28:46.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2020-07-06T13:28:46.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~280s 2020-07-06T13:28:51.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2020-07-06T13:28:51.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2020-07-06T13:28:51.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~285s 2020-07-06T13:28:57.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~291s 2020-07-06T13:28:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~291s 2020-07-06T13:28:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~291s 2020-07-06T13:29:03.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~297s 2020-07-06T13:29:03.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~297s 2020-07-06T13:29:03.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~297s 2020-07-06T13:29:09.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~303s 2020-07-06T13:29:09.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~303s 2020-07-06T13:29:09.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~303s 2020-07-06T13:29:09.009 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-07-06T13:29:09.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T13:29:09.010 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-07-06T13:29:09.010 INFO:teuthology.orchestra.run.smithi148:> ' -- mnt.0) 2020-07-06T13:44:09.017 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2020-07-06T13:44:09.021 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2020-07-06T14:14:03.593 INFO:tasks.ceph.mgr.x.smithi118.stderr:failed to fetch mon config (--no-mon-config to skip) 2020-07-06T14:14:03.629 INFO:tasks.ceph.mgr.y.smithi118.stderr:failed to fetch mon config (--no-mon-config to skip) 2020-07-06T14:14:03.636 INFO:tasks.ceph.mgr.x.smithi118.stderr:daemon-helper: command failed with exit status 1 2020-07-06T14:14:03.700 INFO:tasks.ceph.mgr.y.smithi118.stderr:daemon-helper: command failed with exit status 1 2020-07-06T15:04:03.772 INFO:teuthology.orchestra.run.smithi118.stderr:[errno 110] RADOS timed out (error connecting to the cluster) 2020-07-06T15:04:03.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-06T15:04:03.780 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 90, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 69, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/exec.py", line 54, in task c], File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set global mon_warn_on_msgr2_not_enabled false'" 2020-07-06T15:04:03.862 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=df84b1543cd243168d5cfc9523ebde62 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 90, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 69, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/exec.py", line 54, in task c], File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set global mon_warn_on_msgr2_not_enabled false'" 2020-07-06T15:04:03.863 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-07-06T15:04:03.871 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2020-07-06T15:04:03.894 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-07-06T15:04:03.906 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-07-06T15:04:03.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-07-06T15:04:03.906 INFO:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-07-06T15:04:03.907 INFO:teuthology.orchestra.run.smithi148:> ' -- mnt.0) 2020-07-06T15:19:03.914 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2020-07-06T15:19:05.427 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2020-07-07T01:09:23.336 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-07-07T01:09:23.355 DEBUG:teuthology.task.console_log:Killing console logger for smithi118 2020-07-07T01:09:23.356 DEBUG:teuthology.task.console_log:Killing console logger for smithi148 2020-07-07T01:09:23.357 DEBUG:teuthology.task.console_log:Killing console logger for smithi118 2020-07-07T01:09:23.360 DEBUG:teuthology.task.console_log:Killing console logger for smithi148 2020-07-07T01:09:23.360 DEBUG:teuthology.exit:Finished running handlers